Nov 15 21:20:27 user nova-compute[75409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75409) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 21:20:27 user nova-compute[75409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75409) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 21:20:27 user nova-compute[75409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75409) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 21:20:27 user nova-compute[75409]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 21:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:20:28 user nova-compute[75409]: INFO nova.virt.driver [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 21:20:28 user nova-compute[75409]: INFO nova.compute.provider_config [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Acquiring lock "singleton_lock" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Acquired lock "singleton_lock" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Releasing lock "singleton_lock" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Full set of CONF: {{(pid=75409) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ******************************************************************************** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Configuration options gathered from: {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ================================================================================ {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] allow_resize_to_same_host      = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] arq_binding_timeout            = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] backdoor_port                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] backdoor_socket                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] block_device_allocate_retries  = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] block_device_allocate_retries_interval = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cert                           = self.pem {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute_monitors               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] config_dir                     = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] config_drive_format            = iso9660 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] config_source                  = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] console_host                   = user {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] control_exchange               = nova {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cpu_allocation_ratio           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] daemon                         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] debug                          = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_access_ip_network_name = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_availability_zone      = nova {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_ephemeral_format       = ext4 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_green_pool_size        = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] default_schedule_zone          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] disk_allocation_ratio          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] enable_new_services            = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] enabled_ssl_apis               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] flat_injected                  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] force_config_drive             = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] force_raw_images               = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] graceful_shutdown_timeout      = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] heal_instance_info_cache_interval = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] host                           = user {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_build_timeout         = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_delete_interval       = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_name_template         = instance-%08x {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_usage_audit           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_usage_audit_period    = month {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] internal_service_availability_zone = internal {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] key                            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] live_migration_retry_count     = 30 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_config_append              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_dir                        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_file                       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_options                    = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_rotate_interval            = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_rotate_interval_type       = days {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] log_rotation_type              = none {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] long_rpc_timeout               = 1800 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_concurrent_builds          = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_concurrent_live_migrations = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_concurrent_snapshots       = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_local_block_devices        = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_logfile_count              = 30 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] max_logfile_size_mb            = 200 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] maximum_instance_delete_attempts = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metadata_listen                = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metadata_listen_port           = 8775 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metadata_workers               = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] migrate_max_retries            = -1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] mkisofs_cmd                    = genisoimage {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] my_ip                          = 10.0.0.210 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] network_allocate_retries       = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] osapi_compute_listen_port      = 8774 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] osapi_compute_unique_server_name_scope =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] osapi_compute_workers          = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] password_length                = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] periodic_enable                = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] periodic_fuzzy_delay           = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] pointer_model                  = ps2mouse {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] preallocate_images             = none {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] publish_errors                 = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] pybasedir                      = /opt/stack/nova {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ram_allocation_ratio           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rate_limit_burst               = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rate_limit_except_level        = CRITICAL {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rate_limit_interval            = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reboot_timeout                 = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reclaim_instance_interval      = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] record                         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reimage_timeout_per_gb         = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] report_interval                = 120 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rescue_timeout                 = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reserved_host_cpus             = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reserved_host_disk_mb          = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reserved_host_memory_mb        = 512 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] reserved_huge_pages            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] resize_confirm_window          = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] resize_fs_using_block_device   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] resume_guests_state_on_host_boot = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rpc_response_timeout           = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] run_external_periodic_tasks    = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] running_deleted_instance_action = reap {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] running_deleted_instance_timeout = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler_instance_sync_interval = 120 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_down_time              = 720 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] servicegroup_driver            = db {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] shelved_offload_time           = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] shelved_poll_interval          = 3600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] shutdown_timeout               = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] source_is_ipv6                 = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ssl_only                       = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] state_path                     = /opt/stack/data/nova {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] sync_power_state_interval      = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] sync_power_state_pool_size     = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] syslog_log_facility            = LOG_USER {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] tempdir                        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] timeout_nbd                    = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] transport_url                  = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] update_resources_interval      = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_cow_images                 = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_eventlog                   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_journal                    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_json                       = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_rootwrap_daemon            = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_stderr                     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] use_syslog                     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vcpu_pin_set                   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plugging_is_fatal          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plugging_timeout           = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] virt_mkfs                      = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] volume_usage_poll_interval     = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] watch_log_file                 = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] web                            = /usr/share/spice-html5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_concurrency.disable_process_locking = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.auth_strategy              = keystone {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.compute_link_prefix        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.dhcp_domain                = novalocal {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.enable_instance_password   = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.glance_link_prefix         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.instance_list_per_project_cells = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.list_records_by_skipping_down_cells = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.local_metadata_per_cell    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.max_limit                  = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.metadata_cache_expiration  = 15 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.neutron_default_tenant_id  = default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.use_forwarded_for          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.use_neutron_default_nets   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_dynamic_targets = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_jsonfile_path   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.backend_argument         = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.config_prefix            = cache.oslo {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.dead_timeout             = 60.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.debug_cache_backend      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.enable_retry_client      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.enable_socket_keepalive  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.enabled                  = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.expiration_time          = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.hashclient_retry_attempts = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_dead_retry      = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_password        =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_sasl_enabled    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.memcache_username        =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.proxies                  = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.retry_attempts           = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.retry_delay              = 0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.socket_keepalive_count   = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.socket_keepalive_idle    = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.socket_keepalive_interval = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.tls_allowed_ciphers      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.tls_cafile               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.tls_certfile             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.tls_enabled              = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cache.tls_keyfile              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.auth_section            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.auth_type               = password {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.cafile                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.certfile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.collect_timing          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.cross_az_attach         = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.debug                   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.endpoint_template       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.http_retries            = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.insecure                = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.keyfile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.os_region_name          = RegionOne {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.split_loggers           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cinder.timeout                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.cpu_dedicated_set      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.cpu_shared_set         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.image_type_exclude_list = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.resource_provider_association_refresh = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.shutdown_retry_interval = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] conductor.workers              = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] console.allowed_origins        = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] console.ssl_ciphers            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] console.ssl_minimum_version    = default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] consoleauth.token_ttl          = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.cafile                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.certfile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.collect_timing          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.connect_retries         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.connect_retry_delay     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.endpoint_override       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.insecure                = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.keyfile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.max_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.min_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.region_name             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.service_name            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.service_type            = accelerator {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.split_loggers           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.status_code_retries     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.timeout                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] cyborg.version                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.backend               = sqlalchemy {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.connection            = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.connection_debug      = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.connection_parameters =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.connection_recycle_time = 3600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.connection_trace      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.db_inc_retry_interval = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.db_max_retries        = 20 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.db_max_retry_interval = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.db_retry_interval     = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.max_overflow          = 50 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.max_pool_size         = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.max_retries           = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.mysql_wsrep_sync_wait = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.pool_timeout          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.retry_interval        = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.slave_connection      = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] database.sqlite_synchronous    = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.backend           = sqlalchemy {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.connection        = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.connection_debug  = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.connection_parameters =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.connection_recycle_time = 3600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.connection_trace  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.db_inc_retry_interval = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.db_max_retries    = 20 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.db_max_retry_interval = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.db_retry_interval = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.max_overflow      = 50 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.max_pool_size     = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.max_retries       = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.pool_timeout      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.retry_interval    = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.slave_connection  = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] api_database.sqlite_synchronous = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] devices.enabled_mdev_types     = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ephemeral_storage_encryption.enabled = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.api_servers             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.cafile                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.certfile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.collect_timing          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.connect_retries         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.connect_retry_delay     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.debug                   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.default_trusted_certificate_ids = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.enable_certificate_validation = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.enable_rbd_download     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.endpoint_override       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.insecure                = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.keyfile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.max_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.min_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.num_retries             = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.rbd_ceph_conf           =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.rbd_connect_timeout     = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.rbd_pool                =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.rbd_user                =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.region_name             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.service_name            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.service_type            = image {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.split_loggers           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.status_code_retries     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.timeout                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.verify_glance_signatures = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] glance.version                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] guestfs.debug                  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.config_drive_cdrom      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.config_drive_inject_password = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.enable_remotefx         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.instances_path_share    =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.limit_cpu_features      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.use_multipath_io        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.vswitch_name            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] mks.enabled                    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.manager_interval   = 2400 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.precache_concurrency = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.remove_unused_base_images = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] image_cache.subdirectory_name  = _base {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.api_max_retries         = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.api_retry_interval      = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.auth_section            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.auth_type               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.cafile                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.certfile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.collect_timing          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.conductor_group         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.connect_retries         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.connect_retry_delay     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.endpoint_override       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.insecure                = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.keyfile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.max_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.min_version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.peer_list               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.region_name             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.serial_console_state_timeout = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.service_name            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.service_type            = baremetal {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.split_loggers           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.status_code_retries     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.timeout                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ironic.version                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] key_manager.fixed_key          = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.barbican_api_version  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.barbican_endpoint     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.barbican_endpoint_type = public {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.barbican_region_name  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.cafile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.certfile              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.collect_timing        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.insecure              = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.keyfile               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.number_of_retries     = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.retry_delay           = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.send_service_user_token = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.split_loggers         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.timeout               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.verify_ssl            = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican.verify_ssl_path       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.auth_section = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.auth_type = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.cafile   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.certfile = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.collect_timing = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.insecure = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.keyfile  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.split_loggers = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] barbican_service_user.timeout  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.approle_role_id          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.approle_secret_id        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.cafile                   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.certfile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.collect_timing           = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.insecure                 = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.keyfile                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.kv_mountpoint            = secret {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.kv_path                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.kv_version               = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.namespace                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.root_token_id            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.split_loggers            = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.ssl_ca_crt_file          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.timeout                  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.use_ssl                  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.auth_section          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.auth_type             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.cafile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.certfile              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.collect_timing        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.connect_retries       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.connect_retry_delay   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.endpoint_override     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.insecure              = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.keyfile               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.max_version           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.min_version           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.region_name           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.service_name          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.service_type          = identity {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.split_loggers         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.status_code_retries   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.timeout               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] keystone.version               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.connection_uri         =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_mode               = custom {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: WARNING oslo_config.cfg [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_power_governor_high = performance {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_power_management   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.device_detach_attempts = 8 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.device_detach_timeout  = 20 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.disk_cachemodes        = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.disk_prefix            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.enabled_perf_events    = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.file_backed_memory     = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.gid_maps               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.hw_disk_discard        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.hw_machine_type        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_rbd_pool        = rbd {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_type            = default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.images_volume_group    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.inject_key             = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.inject_partition       = -2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.inject_password        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.iscsi_iface            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.iser_use_multipath     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_downtime = 500 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_inbound_addr = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_scheme  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_timeout_action = abort {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_tunnelled = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: WARNING oslo_config.cfg [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 21:20:28 user nova-compute[75409]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 21:20:28 user nova-compute[75409]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 21:20:28 user nova-compute[75409]: and ``live_migration_inbound_addr`` respectively.
Nov 15 21:20:28 user nova-compute[75409]: ).  Its value may be silently ignored in the future.
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.live_migration_with_native_tls = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.max_queues             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.nfs_mount_options      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_pcie_ports         = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.pmem_namespaces        = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.quobyte_client_cfg     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rbd_secret_uuid        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rbd_user               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rescue_image_id        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rescue_kernel_id       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.rx_queue_size          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.smbfs_mount_options    =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.snapshot_compression   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.snapshot_image_format  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.sparse_logical_volumes = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.swtpm_enabled          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.swtpm_group            = tss {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.swtpm_user             = tss {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.sysinfo_serial         = unique {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.tb_cache_size          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.tx_queue_size          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.uid_maps               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.use_virtio_for_bridges = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.virt_type              = kvm {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.volume_clear           = zero {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.volume_clear_size      = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.volume_use_multipath   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_cache_path   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.auth_section           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.auth_type              = password {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.cafile                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.certfile               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.collect_timing         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.connect_retries        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.connect_retry_delay    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.default_floating_pool  = public {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.endpoint_override      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.extension_sync_interval = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.http_retries           = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.insecure               = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.keyfile                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.max_version            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.min_version            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.ovs_bridge             = br-int {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.physnets               = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.region_name            = RegionOne {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.service_metadata_proxy = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.service_name           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.service_type           = network {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.split_loggers          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.status_code_retries    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.timeout                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] neutron.version                = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] notifications.bdms_in_notifications = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] notifications.default_level    = INFO {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] notifications.notification_format = unversioned {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] notifications.notify_on_state_change = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] pci.alias                      = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] pci.device_spec                = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] pci.report_in_placement        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.auth_section         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.auth_type            = password {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.cafile               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.certfile             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.collect_timing       = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.connect_retries      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.connect_retry_delay  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.default_domain_id    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.default_domain_name  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.domain_id            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.domain_name          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.endpoint_override    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.insecure             = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.keyfile              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.max_version          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.min_version          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.password             = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.project_domain_id    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.project_domain_name  = Default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.project_id           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.project_name         = service {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.region_name          = RegionOne {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.service_name         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.service_type         = placement {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.split_loggers        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.status_code_retries  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.system_scope         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.timeout              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.trust_id             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.user_domain_id       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.user_domain_name     = Default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.user_id              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.username             = placement {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] placement.version              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.cores                    = 20 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.count_usage_from_placement = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.injected_file_content_bytes = 10240 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.injected_file_path_length = 255 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.injected_files           = 5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.instances                = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.key_pairs                = 100 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.metadata_items           = 128 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.ram                      = 51200 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.recheck_quota            = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.server_group_members     = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] quota.server_groups            = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rdp.enabled                    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.image_metadata_prefilter = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.max_attempts         = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.max_placement_results = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] scheduler.workers              = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.host_subset_size = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.isolated_hosts = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.isolated_images = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.pci_in_placement = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.track_instance_changes = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metrics.required               = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metrics.weight_multiplier      = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] metrics.weight_setting         = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.enabled         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.port_range      = 10000:20000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] serial_console.serialproxy_port = 6083 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.auth_section      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.auth_type         = password {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.cafile            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.certfile          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.collect_timing    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.insecure          = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.keyfile           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.send_service_user_token = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.split_loggers     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] service_user.timeout           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.agent_enabled            = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.enabled                  = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.html5proxy_port          = 6082 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.image_compression        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.jpeg_compression         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.playback_compression     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.server_listen            = 127.0.0.1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.streaming_mode           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] spice.zlib_compression         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] upgrade_levels.baseapi         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] upgrade_levels.cert            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] upgrade_levels.compute         = auto {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] upgrade_levels.conductor       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] upgrade_levels.scheduler       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.cafile = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.certfile = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.insecure = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vendordata_dynamic_auth.timeout = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.api_retry_count         = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.ca_file                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.cache_prefix            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.cluster_name            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.connection_pool_size    = 10 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.console_delay_seconds   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.datastore_regex         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.host_ip                 = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.host_password           = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.host_port               = 443 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.host_username           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.insecure                = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.integration_bridge      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.maximum_objects         = 100 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.pbm_default_policy      = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.pbm_enabled             = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.pbm_wsdl_location       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.serial_port_proxy_uri   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.serial_port_service_uri = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.task_poll_interval      = 0.5 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.use_linked_clone        = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.vnc_keymap              = en-us {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.vnc_port                = 5900 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vmware.vnc_port_total          = 10000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.auth_schemes               = ['none'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.enabled                    = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.novncproxy_port            = 6080 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.vencrypt_ca_certs          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.vencrypt_client_cert       = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vnc.vencrypt_client_key        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.disable_rootwrap   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.enable_numa_live_migration = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.libvirt_disable_apic = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.client_socket_timeout     = 900 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.default_pool_size         = 1000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.keep_alive                = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.max_header_line           = 16384 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.ssl_ca_file               = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.ssl_cert_file             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.ssl_key_file              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.tcp_keepidle              = 600 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] zvm.ca_file                    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] zvm.cloud_connector_url        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] zvm.reachable_timeout          = 300 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.enforce_new_defaults = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.enforce_scope      = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.policy_default_rule = default {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.connection_string     = messaging:// {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.enabled               = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.es_doc_type           = notification {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.es_scroll_size        = 10000 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.es_scroll_time        = 2m {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.filter_error_trace    = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.hmac_keys             = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.sentinel_service_name = mymaster {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.socket_timeout        = 0.1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.trace_requests        = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler.trace_sqlalchemy      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler_jaeger.process_tags   = {} {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler_jaeger.service_name_prefix = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] profiler_otlp.service_name_prefix = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] remote_debug.host              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] remote_debug.port              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_notifications.retry = -1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.auth_section        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.auth_type           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.cafile              = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.certfile            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.collect_timing      = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.connect_retries     = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.connect_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.endpoint_id         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.endpoint_override   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.insecure            = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.keyfile             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.max_version         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.min_version         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.region_name         = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.service_name        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.service_type        = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.split_loggers       = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.status_code_retries = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.status_code_retry_delay = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.timeout             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.valid_interfaces    = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_limit.version             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_reports.file_event_handler = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] oslo_reports.log_dir           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.group  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] vif_plug_ovs_privileged.user   = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.isolate_vif         = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] os_brick.lock_path             = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.capabilities   = [21] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.group          = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.helper_command = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] privsep_osbrick.user           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.group           = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.helper_command  = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] nova_sys_admin.user            = None {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG oslo_service.service [None req-46459e6f-f65f-4ad8-8b65-97c8db7e0301 None None] ******************************************************************************** {{(pid=75409) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 21:20:28 user nova-compute[75409]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Connecting to libvirt: qemu:///system {{(pid=75409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7faf4bdee440> {{(pid=75409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 21:20:28 user nova-compute[75409]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 21:20:28 user nova-compute[75409]: WARNING nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7faf4bdee440> {{(pid=75409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Starting native event thread {{(pid=75409) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Starting green dispatch thread {{(pid=75409) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Starting connection event dispatch thread {{(pid=75409) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 21:20:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Connection event '1' reason 'None'
Nov 15 21:20:28 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 21:20:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.mount [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Initialising _HostMountState generation 0 {{(pid=75409) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 21:20:35 user nova-compute[75409]: INFO nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host capabilities <capabilities>
Nov 15 21:20:35 user nova-compute[75409]:   <host>
Nov 15 21:20:35 user nova-compute[75409]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 21:20:35 user nova-compute[75409]:     <cpu>
Nov 15 21:20:35 user nova-compute[75409]:       <arch>x86_64</arch>
Nov 15 21:20:35 user nova-compute[75409]:       <model>IvyBridge-IBRS</model>
Nov 15 21:20:35 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:35 user nova-compute[75409]:       <microcode version='1070'/>
Nov 15 21:20:35 user nova-compute[75409]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 21:20:35 user nova-compute[75409]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='ss'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='vmx'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='pcid'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='osxsave'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='hypervisor'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='arat'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='tsc_adjust'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='md-clear'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='stibp'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='arch-capabilities'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='ssbd'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='invtsc'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='rsba'/>
Nov 15 21:20:35 user nova-compute[75409]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 21:20:35 user nova-compute[75409]:       <pages unit='KiB' size='4'/>
Nov 15 21:20:35 user nova-compute[75409]:       <pages unit='KiB' size='2048'/>
Nov 15 21:20:35 user nova-compute[75409]:     </cpu>
Nov 15 21:20:35 user nova-compute[75409]:     <power_management>
Nov 15 21:20:35 user nova-compute[75409]:       <suspend_mem/>
Nov 15 21:20:35 user nova-compute[75409]:       <suspend_disk/>
Nov 15 21:20:35 user nova-compute[75409]:       <suspend_hybrid/>
Nov 15 21:20:35 user nova-compute[75409]:     </power_management>
Nov 15 21:20:35 user nova-compute[75409]:     <iommu support='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     <migration_features>
Nov 15 21:20:35 user nova-compute[75409]:       <live/>
Nov 15 21:20:35 user nova-compute[75409]:       <uri_transports>
Nov 15 21:20:35 user nova-compute[75409]:         <uri_transport>tcp</uri_transport>
Nov 15 21:20:35 user nova-compute[75409]:         <uri_transport>rdma</uri_transport>
Nov 15 21:20:35 user nova-compute[75409]:       </uri_transports>
Nov 15 21:20:35 user nova-compute[75409]:     </migration_features>
Nov 15 21:20:35 user nova-compute[75409]:     <topology>
Nov 15 21:20:35 user nova-compute[75409]:       <cells num='2'>
Nov 15 21:20:35 user nova-compute[75409]:         <cell id='0'>
Nov 15 21:20:35 user nova-compute[75409]:           <memory unit='KiB'>8189224</memory>
Nov 15 21:20:35 user nova-compute[75409]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 21:20:35 user nova-compute[75409]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 21:20:35 user nova-compute[75409]:           <distances>
Nov 15 21:20:35 user nova-compute[75409]:             <sibling id='0' value='10'/>
Nov 15 21:20:35 user nova-compute[75409]:             <sibling id='1' value='20'/>
Nov 15 21:20:35 user nova-compute[75409]:           </distances>
Nov 15 21:20:35 user nova-compute[75409]:           <cpus num='6'>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 21:20:35 user nova-compute[75409]:           </cpus>
Nov 15 21:20:35 user nova-compute[75409]:         </cell>
Nov 15 21:20:35 user nova-compute[75409]:         <cell id='1'>
Nov 15 21:20:35 user nova-compute[75409]:           <memory unit='KiB'>8206460</memory>
Nov 15 21:20:35 user nova-compute[75409]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 21:20:35 user nova-compute[75409]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 21:20:35 user nova-compute[75409]:           <distances>
Nov 15 21:20:35 user nova-compute[75409]:             <sibling id='0' value='20'/>
Nov 15 21:20:35 user nova-compute[75409]:             <sibling id='1' value='10'/>
Nov 15 21:20:35 user nova-compute[75409]:           </distances>
Nov 15 21:20:35 user nova-compute[75409]:           <cpus num='6'>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 21:20:35 user nova-compute[75409]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 21:20:35 user nova-compute[75409]:           </cpus>
Nov 15 21:20:35 user nova-compute[75409]:         </cell>
Nov 15 21:20:35 user nova-compute[75409]:       </cells>
Nov 15 21:20:35 user nova-compute[75409]:     </topology>
Nov 15 21:20:35 user nova-compute[75409]:     <cache>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 21:20:35 user nova-compute[75409]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 21:20:35 user nova-compute[75409]:     </cache>
Nov 15 21:20:35 user nova-compute[75409]:     <secmodel>
Nov 15 21:20:35 user nova-compute[75409]:       <model>apparmor</model>
Nov 15 21:20:35 user nova-compute[75409]:       <doi>0</doi>
Nov 15 21:20:35 user nova-compute[75409]:     </secmodel>
Nov 15 21:20:35 user nova-compute[75409]:     <secmodel>
Nov 15 21:20:35 user nova-compute[75409]:       <model>dac</model>
Nov 15 21:20:35 user nova-compute[75409]:       <doi>0</doi>
Nov 15 21:20:35 user nova-compute[75409]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 21:20:35 user nova-compute[75409]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 21:20:35 user nova-compute[75409]:     </secmodel>
Nov 15 21:20:35 user nova-compute[75409]:   </host>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='alpha'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>clipper</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:35 user nova-compute[75409]:     </arch>
Nov 15 21:20:35 user nova-compute[75409]:     <features>
Nov 15 21:20:35 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:35 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:35 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     </features>
Nov 15 21:20:35 user nova-compute[75409]:   </guest>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='armv6l'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>spitz</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>nuri</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>kzm</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>z2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>tosa</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n810</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n800</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>terrier</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>midway</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>microbit</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>verdex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>highbank</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>akita</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>connex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>collie</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:35 user nova-compute[75409]:     </arch>
Nov 15 21:20:35 user nova-compute[75409]:     <features>
Nov 15 21:20:35 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:35 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:35 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     </features>
Nov 15 21:20:35 user nova-compute[75409]:   </guest>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='armv7l'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>spitz</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>nuri</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>kzm</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>z2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>tosa</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n810</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n800</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>terrier</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>midway</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>microbit</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>verdex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>highbank</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>akita</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>connex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>collie</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:35 user nova-compute[75409]:     </arch>
Nov 15 21:20:35 user nova-compute[75409]:     <features>
Nov 15 21:20:35 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:35 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:35 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     </features>
Nov 15 21:20:35 user nova-compute[75409]:   </guest>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='aarch64'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>spitz</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>nuri</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>kzm</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>z2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>tosa</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n810</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>n800</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>terrier</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>midway</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>microbit</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>verdex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='4'>highbank</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>akita</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>connex</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>collie</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:35 user nova-compute[75409]:     </arch>
Nov 15 21:20:35 user nova-compute[75409]:     <features>
Nov 15 21:20:35 user nova-compute[75409]:       <acpi default='on' toggle='yes'/>
Nov 15 21:20:35 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:35 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:35 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     </features>
Nov 15 21:20:35 user nova-compute[75409]:   </guest>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='cris'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:35 user nova-compute[75409]:     </arch>
Nov 15 21:20:35 user nova-compute[75409]:     <features>
Nov 15 21:20:35 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:35 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:35 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:35 user nova-compute[75409]:     </features>
Nov 15 21:20:35 user nova-compute[75409]:   </guest>
Nov 15 21:20:35 user nova-compute[75409]:   <guest>
Nov 15 21:20:35 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:35 user nova-compute[75409]:     <arch name='i686'>
Nov 15 21:20:35 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:35 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 21:20:35 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>isapc</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>microvm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='kvm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <pae/>
Nov 15 21:20:36 user nova-compute[75409]:       <nonpae/>
Nov 15 21:20:36 user nova-compute[75409]:       <acpi default='on' toggle='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:       <apic default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='m68k'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>an5206</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>q800</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='microblaze'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='microblazeel'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='mips'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>malta</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='mipsel'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>malta</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='mips64'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>malta</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>pica61</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>magnum</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='mips64el'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>malta</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>pica61</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>magnum</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='16'>boston</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='ppc'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mac99</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>40p</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>taihu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='ppc64'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>taihu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>40p</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mac99</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='ppc64le'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>taihu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>40p</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>mac99</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='riscv32'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='8'>spike</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='8'>virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='riscv64'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='8'>spike</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='8'>virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='s390x'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='sh4'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>shix</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>r2d</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='sh4eb'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>shix</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>r2d</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='sparc'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>LX</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='sparc64'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>niagara</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='x86_64'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>64</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='1'>isapc</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>microvm</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='kvm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <acpi default='on' toggle='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:       <apic default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='xtensa'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='4'>sim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>kc705</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ml605</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx200</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx60</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]:   <guest>
Nov 15 21:20:36 user nova-compute[75409]:     <os_type>hvm</os_type>
Nov 15 21:20:36 user nova-compute[75409]:     <arch name='xtensaeb'>
Nov 15 21:20:36 user nova-compute[75409]:       <wordsize>32</wordsize>
Nov 15 21:20:36 user nova-compute[75409]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='4'>sim</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>kc705</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ml605</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>virt</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx200</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>lx60</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 21:20:36 user nova-compute[75409]:       <domain type='qemu'/>
Nov 15 21:20:36 user nova-compute[75409]:     </arch>
Nov 15 21:20:36 user nova-compute[75409]:     <features>
Nov 15 21:20:36 user nova-compute[75409]:       <cpuselection/>
Nov 15 21:20:36 user nova-compute[75409]:       <deviceboot/>
Nov 15 21:20:36 user nova-compute[75409]:       <disksnapshot default='on' toggle='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     </features>
Nov 15 21:20:36 user nova-compute[75409]:   </guest>
Nov 15 21:20:36 user nova-compute[75409]: </capabilities>
Nov 15 21:20:36 user nova-compute[75409]: 
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-i440fx-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>i686</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='255'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'/>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='lm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ide</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-q35-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>i686</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='288'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'/>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='lm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-i440fx-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>i686</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='255'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'/>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='lm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ide</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-q35-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>i686</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='288'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'/>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='lm'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-i440fx-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>x86_64</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='255'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>efi</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='invtsc'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='rsba'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ide</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-q35-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>x86_64</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='288'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>efi</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='invtsc'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='rsba'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-i440fx-6.2</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>x86_64</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='255'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>efi</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='invtsc'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='rsba'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ide</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 21:20:36 user nova-compute[75409]: <domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 21:20:36 user nova-compute[75409]:   <domain>kvm</domain>
Nov 15 21:20:36 user nova-compute[75409]:   <machine>pc-q35-jammy</machine>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>x86_64</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <vcpu max='288'/>
Nov 15 21:20:36 user nova-compute[75409]:   <iothreads supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:   <os supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='firmware'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>efi</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:     <loader supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>rom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pflash</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='readonly'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='secure'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>yes</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>no</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </loader>
Nov 15 21:20:36 user nova-compute[75409]:   </os>
Nov 15 21:20:36 user nova-compute[75409]:   <cpu>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-passthrough' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='hostPassthroughMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='maximum' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='maximumMigratable'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>on</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>off</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='host-model' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ss'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='vmx'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pcid'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='hypervisor'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arat'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='umip'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='md-clear'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='invtsc'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibpb'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='ibrs'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-stibp'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='rsba'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='erms'/>
Nov 15 21:20:36 user nova-compute[75409]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:     <mode name='custom' supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>qemu64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>qemu32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>phenom</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>pentium</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>n270</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm64</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>kvm32</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>coreduo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>core2duo</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>athlon</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Westmere</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Snowridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Skylake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>SandyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Penryn</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G5</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G4</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G3</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Opteron_G2</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Opteron_G1</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>IvyBridge</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Icelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Haswell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Rome</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-Milan</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>EPYC</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Dhyana</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cooperlake</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>Conroe</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='no'>Broadwell</model>
Nov 15 21:20:36 user nova-compute[75409]:       <model usable='yes'>486</model>
Nov 15 21:20:36 user nova-compute[75409]:     </mode>
Nov 15 21:20:36 user nova-compute[75409]:   </cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <memoryBacking supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:     <enum name='sourceType'>
Nov 15 21:20:36 user nova-compute[75409]:       <value>file</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>anonymous</value>
Nov 15 21:20:36 user nova-compute[75409]:       <value>memfd</value>
Nov 15 21:20:36 user nova-compute[75409]:     </enum>
Nov 15 21:20:36 user nova-compute[75409]:   </memoryBacking>
Nov 15 21:20:36 user nova-compute[75409]:   <devices>
Nov 15 21:20:36 user nova-compute[75409]:     <disk supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='diskDevice'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>disk</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cdrom</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>floppy</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>lun</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='bus'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>fdc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sata</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </disk>
Nov 15 21:20:36 user nova-compute[75409]:     <graphics supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='type'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>sdl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vnc</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>spice</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egl-headless</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </graphics>
Nov 15 21:20:36 user nova-compute[75409]:     <video supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='modelType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>cirrus</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>vmvga</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>qxl</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>none</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>bochs</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>ramfb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </video>
Nov 15 21:20:36 user nova-compute[75409]:     <hostdev supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='mode'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>subsystem</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='startupPolicy'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>default</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>mandatory</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>requisite</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>optional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='subsysType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>usb</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>pci</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>scsi</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='capsType'/>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='pciBackend'/>
Nov 15 21:20:36 user nova-compute[75409]:     </hostdev>
Nov 15 21:20:36 user nova-compute[75409]:     <rng supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtio-non-transitional</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>random</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>egd</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>builtin</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </rng>
Nov 15 21:20:36 user nova-compute[75409]:     <filesystem supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='driverType'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>path</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>handle</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>virtiofs</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </filesystem>
Nov 15 21:20:36 user nova-compute[75409]:     <tpm supported='yes'>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='model'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-tis</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>tpm-crb</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:       <enum name='backendModel'>
Nov 15 21:20:36 user nova-compute[75409]:         <value>passthrough</value>
Nov 15 21:20:36 user nova-compute[75409]:         <value>emulator</value>
Nov 15 21:20:36 user nova-compute[75409]:       </enum>
Nov 15 21:20:36 user nova-compute[75409]:     </tpm>
Nov 15 21:20:36 user nova-compute[75409]:   </devices>
Nov 15 21:20:36 user nova-compute[75409]:   <features>
Nov 15 21:20:36 user nova-compute[75409]:     <gic supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:     <vmcoreinfo supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <genid supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backingStoreInput supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <backup supported='yes'/>
Nov 15 21:20:36 user nova-compute[75409]:     <sev supported='no'/>
Nov 15 21:20:36 user nova-compute[75409]:   </features>
Nov 15 21:20:36 user nova-compute[75409]: </domainCapabilities>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=75409) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=75409) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Checking secure boot support for host arch (x86_64) {{(pid=75409) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Secure Boot support detected
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] cpu compare xml: <cpu match="exact">
Nov 15 21:20:36 user nova-compute[75409]:   <model>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]: </cpu>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.virt.node [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Generated node identity 6d992785-dcac-407e-b10c-2f8c1f949a7e
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.virt.node [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Wrote node identity 6d992785-dcac-407e-b10c-2f8c1f949a7e to /opt/stack/data/nova/compute_id
Nov 15 21:20:36 user nova-compute[75409]: WARNING nova.compute.manager [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Compute nodes ['6d992785-dcac-407e-b10c-2f8c1f949a7e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.compute.manager [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 21:20:36 user nova-compute[75409]: WARNING nova.compute.manager [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 21:20:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:20:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:20:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Hypervisor/Node resource view: name=user free_ram=11059MB free_disk=26.09384536743164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:20:36 user nova-compute[75409]: WARNING nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] No compute node record for user:6d992785-dcac-407e-b10c-2f8c1f949a7e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6d992785-dcac-407e-b10c-2f8c1f949a7e could not be found.
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Compute node record created for user:user with uuid: 6d992785-dcac-407e-b10c-2f8c1f949a7e
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] [req-ff3b791e-93ab-469e-af88-79030af658eb] Created resource provider record via placement API for resource provider with UUID 6d992785-dcac-407e-b10c-2f8c1f949a7e and name user.
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75409) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 21:20:36 user nova-compute[75409]: INFO nova.virt.libvirt.host [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] kernel doesn't support AMD SEV
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:20:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Libvirt baseline CPU <cpu>
Nov 15 21:20:36 user nova-compute[75409]:   <arch>x86_64</arch>
Nov 15 21:20:36 user nova-compute[75409]:   <model>Nehalem</model>
Nov 15 21:20:36 user nova-compute[75409]:   <vendor>Intel</vendor>
Nov 15 21:20:36 user nova-compute[75409]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 21:20:36 user nova-compute[75409]: </cpu>
Nov 15 21:20:36 user nova-compute[75409]:  {{(pid=75409) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Updated inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Updating resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e generation from 0 to 1 during operation: update_inventory {{(pid=75409) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Updating resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e generation from 1 to 2 during operation: update_traits {{(pid=75409) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.service [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Creating RPC server for service compute {{(pid=75409) start /opt/stack/nova/nova/service.py:182}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.service [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] Join ServiceGroup membership for this service compute {{(pid=75409) start /opt/stack/nova/nova/service.py:199}}
Nov 15 21:20:37 user nova-compute[75409]: DEBUG nova.servicegroup.drivers.db [None req-c9f196f2-891c-4846-a04c-92eb47ea7d5a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75409) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 21:20:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:20:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:21:28 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:21:28 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=10414MB free_disk=25.99756622314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:21:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:22:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:22:29 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:22:29 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=26.06175994873047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:22:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:22:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:23:30 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:23:30 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=10418MB free_disk=25.814281463623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:23:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:23:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:23:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:23:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:23:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:24:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:24:31 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:31 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9657MB free_disk=25.833370208740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:24:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:24:33 user nova-compute[75409]: INFO nova.compute.claims [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Claim successful on node user
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:24:33 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:24:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:24:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:24:34 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Creating image(s)
Nov 15 21:24:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "/opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "/opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:34 user nova-compute[75409]: DEBUG nova.policy [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cdc66ccd2954c3386ad848d7905af53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee71a3b7d76412ba5333fb7b342e70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.part --force-share --output=json" returned: 0 in 0.265s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG nova.virt.images [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] 76e2224a-f851-4f51-8b88-3264d76e2cea was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.part /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.part /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.converted" returned: 0 in 0.385s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.749s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:36 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkl5e2oh9/privsep.sock']
Nov 15 21:24:36 user sudo[84643]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkl5e2oh9/privsep.sock
Nov 15 21:24:36 user sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 21:24:36 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Successfully created port: 2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:24:37 user sudo[84643]: pam_unix(sudo:session): session closed for user root
Nov 15 21:24:37 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Spawned new privsep daemon via rootwrap
Nov 15 21:24:37 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 21:24:37 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 21:24:37 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 21:24:37 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84651
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk 1073741824" returned: 0 in 0.043s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.195s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Cannot resize image /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Ensure instance console log exists: /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Successfully updated port: 2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquired lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:38 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:24:38 user nova-compute[75409]: INFO nova.compute.claims [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Claim successful on node user
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-changed-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Refreshing instance network info cache due to event network-changed-2a29befb-ea76-4786-b40c-373d69091e51. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] Acquiring lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:24:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.policy [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceded6a59a6842e792ad3aced2b85da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dfeeef89eb4141be700d34d6d0f1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:24:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Creating image(s)
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updating instance_info_cache with network_info: [{"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Releasing lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Instance network_info: |[{"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] Acquired lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.neutron [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Refreshing network info cache for port 2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Start _get_guest_xml network_info=[{"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:24:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1728322071',display_name='tempest-DeleteServersTestJSON-server-1728322071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1728322071',id=1,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee71a3b7d76412ba5333fb7b342e70b',ramdisk_id='',reservation_id='r-szjcvkng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1966991890',owner_user_name='tempest-DeleteServersTestJSON-1966991890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:34Z,user_data=None,user_id='9cdc66ccd2954c3386ad848d7905af53',uuid=ef0e75f6-944c-4960-8548-4de9db2e5655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converting VIF {"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lazy-loading 'pci_devices' on Instance uuid ef0e75f6-944c-4960-8548-4de9db2e5655 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.272s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:24:40 user nova-compute[75409]:   <uuid>ef0e75f6-944c-4960-8548-4de9db2e5655</uuid>
Nov 15 21:24:40 user nova-compute[75409]:   <name>instance-00000001</name>
Nov 15 21:24:40 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:24:40 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:24:40 user nova-compute[75409]:   <metadata>
Nov 15 21:24:40 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:24:40 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:name>tempest-DeleteServersTestJSON-server-1728322071</nova:name>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:24:39</nova:creationTime>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:24:40 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:24:40 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:owner>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:user uuid="9cdc66ccd2954c3386ad848d7905af53">tempest-DeleteServersTestJSON-1966991890-project-member</nova:user>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:project uuid="bee71a3b7d76412ba5333fb7b342e70b">tempest-DeleteServersTestJSON-1966991890</nova:project>
Nov 15 21:24:40 user nova-compute[75409]:       </nova:owner>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:24:40 user nova-compute[75409]:       <nova:ports>
Nov 15 21:24:40 user nova-compute[75409]:         <nova:port uuid="2a29befb-ea76-4786-b40c-373d69091e51">
Nov 15 21:24:40 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:24:40 user nova-compute[75409]:         </nova:port>
Nov 15 21:24:40 user nova-compute[75409]:       </nova:ports>
Nov 15 21:24:40 user nova-compute[75409]:     </nova:instance>
Nov 15 21:24:40 user nova-compute[75409]:   </metadata>
Nov 15 21:24:40 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:24:40 user nova-compute[75409]:     <system>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="serial">ef0e75f6-944c-4960-8548-4de9db2e5655</entry>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="uuid">ef0e75f6-944c-4960-8548-4de9db2e5655</entry>
Nov 15 21:24:40 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:24:40 user nova-compute[75409]:     </system>
Nov 15 21:24:40 user nova-compute[75409]:   </sysinfo>
Nov 15 21:24:40 user nova-compute[75409]:   <os>
Nov 15 21:24:40 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:24:40 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:24:40 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:24:40 user nova-compute[75409]:   </os>
Nov 15 21:24:40 user nova-compute[75409]:   <features>
Nov 15 21:24:40 user nova-compute[75409]:     <acpi/>
Nov 15 21:24:40 user nova-compute[75409]:     <apic/>
Nov 15 21:24:40 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:24:40 user nova-compute[75409]:   </features>
Nov 15 21:24:40 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:24:40 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:24:40 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:24:40 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:24:40 user nova-compute[75409]:   </clock>
Nov 15 21:24:40 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:24:40 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:24:40 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:24:40 user nova-compute[75409]:   </cpu>
Nov 15 21:24:40 user nova-compute[75409]:   <devices>
Nov 15 21:24:40 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:24:40 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:24:40 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk"/>
Nov 15 21:24:40 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:24:40 user nova-compute[75409]:     </disk>
Nov 15 21:24:40 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:24:40 user nova-compute[75409]:       <mac address="fa:16:3e:01:51:21"/>
Nov 15 21:24:40 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:40 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:24:40 user nova-compute[75409]:       <target dev="tap2a29befb-ea"/>
Nov 15 21:24:40 user nova-compute[75409]:     </interface>
Nov 15 21:24:40 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:24:40 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/console.log" append="off"/>
Nov 15 21:24:40 user nova-compute[75409]:     </serial>
Nov 15 21:24:40 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:24:40 user nova-compute[75409]:     <video>
Nov 15 21:24:40 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:40 user nova-compute[75409]:     </video>
Nov 15 21:24:40 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:24:40 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:24:40 user nova-compute[75409]:     </rng>
Nov 15 21:24:40 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:24:40 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:24:40 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:24:40 user nova-compute[75409]:     </memballoon>
Nov 15 21:24:40 user nova-compute[75409]:   </devices>
Nov 15 21:24:40 user nova-compute[75409]: </domain>
Nov 15 21:24:40 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1728322071',display_name='tempest-DeleteServersTestJSON-server-1728322071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1728322071',id=1,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bee71a3b7d76412ba5333fb7b342e70b',ramdisk_id='',reservation_id='r-szjcvkng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1966991890',owner_user_name='tempest-DeleteServersTestJSON-1966991890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:34Z,user_data=None,user_id='9cdc66ccd2954c3386ad848d7905af53',uuid=ef0e75f6-944c-4960-8548-4de9db2e5655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converting VIF {"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG os_vif [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Created schema index Interface.name {{(pid=75409) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Created schema index Port.name {{(pid=75409) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Created schema index Bridge.name {{(pid=75409) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [POLLOUT] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.279s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77e2d065-5099-5c0f-8e24-f96eabc5bd56', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:40 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp30i1js7q/privsep.sock']
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk 1073741824" returned: 0 in 0.065s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:40 user sudo[84690]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp30i1js7q/privsep.sock
Nov 15 21:24:40 user sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Cannot resize image /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Ensure instance console log exists: /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.network.neutron [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updated VIF entry in instance network info cache for port 2a29befb-ea76-4786-b40c-373d69091e51. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG nova.network.neutron [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updating instance_info_cache with network_info: [{"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a2c13d1-86e4-4cdd-97f4-7c17412eefba req-dc851091-b832-4d69-975c-a5eef383de1d service nova] Releasing lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:41 user sudo[84690]: pam_unix(sudo:session): session closed for user root
Nov 15 21:24:41 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Spawned new privsep daemon via rootwrap
Nov 15 21:24:41 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 21:24:41 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 21:24:41 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 21:24:41 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84698
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a29befb-ea, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a29befb-ea, col_values=(('qos', UUID('69c3d8a4-62c1-4b26-8268-c593d2dc44ea')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a29befb-ea, col_values=(('external_ids', {'iface-id': '2a29befb-ea76-4786-b40c-373d69091e51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:51:21', 'vm-uuid': 'ef0e75f6-944c-4960-8548-4de9db2e5655'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:42 user nova-compute[75409]: INFO os_vif [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea')
Nov 15 21:24:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Successfully created port: d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:24:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] No VIF found with MAC fa:16:3e:01:51:21, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:24:43 user nova-compute[75409]: INFO nova.compute.claims [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Claim successful on node user
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:24:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:24:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Creating image(s)
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG nova.policy [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dc1671b61544734b8af9c67182684ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d175092693d4075a673abd4700224b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.163s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk 1073741824" returned: 0 in 0.048s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.236s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Cannot resize image /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Ensure instance console log exists: /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Successfully updated port: d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:24:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Instance spawned successfully.
Nov 15 21:24:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing instance network info cache due to event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:46 user nova-compute[75409]: INFO nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Took 11.91 seconds to spawn the instance on the hypervisor.
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:24:46 user nova-compute[75409]: INFO nova.compute.manager [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Took 13.13 seconds to build instance.
Nov 15 21:24:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-15bb055d-4837-4e06-b07a-c68ab0f59f0b tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.390s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Successfully created port: 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance network_info: |[{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start _get_guest_xml network_info=[{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:24:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvhddLOARROj0AE+nWXziseLRd++fgTkb1aARPcvoXOTf1W6vh8nbbCd7hGGt6F4fpgez+/iZ9ovxv2kLP5GxxnHe0IWvqGdnBCRQJB7B6nApL+59XsaiwyQgBrkG/yLQ==',key_name='tempest-keypair-289692261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_devices' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:24:46 user nova-compute[75409]:   <uuid>77ef017e-9905-491a-9def-b81e289ac07b</uuid>
Nov 15 21:24:46 user nova-compute[75409]:   <name>instance-00000002</name>
Nov 15 21:24:46 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:24:46 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:24:46 user nova-compute[75409]:   <metadata>
Nov 15 21:24:46 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:24:46 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1521868239</nova:name>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:24:46</nova:creationTime>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:24:46 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:24:46 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:owner>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:user uuid="ceded6a59a6842e792ad3aced2b85da9">tempest-AttachVolumeShelveTestJSON-1237497947-project-member</nova:user>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:project uuid="46dfeeef89eb4141be700d34d6d0f1ea">tempest-AttachVolumeShelveTestJSON-1237497947</nova:project>
Nov 15 21:24:46 user nova-compute[75409]:       </nova:owner>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:24:46 user nova-compute[75409]:       <nova:ports>
Nov 15 21:24:46 user nova-compute[75409]:         <nova:port uuid="d098b838-c6bc-49e1-9021-293a1b527c93">
Nov 15 21:24:46 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 21:24:46 user nova-compute[75409]:         </nova:port>
Nov 15 21:24:46 user nova-compute[75409]:       </nova:ports>
Nov 15 21:24:46 user nova-compute[75409]:     </nova:instance>
Nov 15 21:24:46 user nova-compute[75409]:   </metadata>
Nov 15 21:24:46 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:24:46 user nova-compute[75409]:     <system>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="serial">77ef017e-9905-491a-9def-b81e289ac07b</entry>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="uuid">77ef017e-9905-491a-9def-b81e289ac07b</entry>
Nov 15 21:24:46 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:24:46 user nova-compute[75409]:     </system>
Nov 15 21:24:46 user nova-compute[75409]:   </sysinfo>
Nov 15 21:24:46 user nova-compute[75409]:   <os>
Nov 15 21:24:46 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:24:46 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:24:46 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:24:46 user nova-compute[75409]:   </os>
Nov 15 21:24:46 user nova-compute[75409]:   <features>
Nov 15 21:24:46 user nova-compute[75409]:     <acpi/>
Nov 15 21:24:46 user nova-compute[75409]:     <apic/>
Nov 15 21:24:46 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:24:46 user nova-compute[75409]:   </features>
Nov 15 21:24:46 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:24:46 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:24:46 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:24:46 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:24:46 user nova-compute[75409]:   </clock>
Nov 15 21:24:46 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:24:46 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:24:46 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:24:46 user nova-compute[75409]:   </cpu>
Nov 15 21:24:46 user nova-compute[75409]:   <devices>
Nov 15 21:24:46 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:24:46 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:24:46 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk"/>
Nov 15 21:24:46 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:24:46 user nova-compute[75409]:     </disk>
Nov 15 21:24:46 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:24:46 user nova-compute[75409]:       <mac address="fa:16:3e:c5:59:0d"/>
Nov 15 21:24:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:46 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:24:46 user nova-compute[75409]:       <target dev="tapd098b838-c6"/>
Nov 15 21:24:46 user nova-compute[75409]:     </interface>
Nov 15 21:24:46 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:24:46 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/console.log" append="off"/>
Nov 15 21:24:46 user nova-compute[75409]:     </serial>
Nov 15 21:24:46 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:24:46 user nova-compute[75409]:     <video>
Nov 15 21:24:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:46 user nova-compute[75409]:     </video>
Nov 15 21:24:46 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:24:46 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:24:46 user nova-compute[75409]:     </rng>
Nov 15 21:24:46 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:24:46 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:24:46 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:24:46 user nova-compute[75409]:     </memballoon>
Nov 15 21:24:46 user nova-compute[75409]:   </devices>
Nov 15 21:24:46 user nova-compute[75409]: </domain>
Nov 15 21:24:46 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvhddLOARROj0AE+nWXziseLRd++fgTkb1aARPcvoXOTf1W6vh8nbbCd7hGGt6F4fpgez+/iZ9ovxv2kLP5GxxnHe0IWvqGdnBCRQJB7B6nApL+59XsaiwyQgBrkG/yLQ==',key_name='tempest-keypair-289692261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG os_vif [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499168b8-ec17-5724-b775-22e6676a781b', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd098b838-c6, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd098b838-c6, col_values=(('qos', UUID('b52de2ad-3b80-4d3e-be29-7ffba4bafe02')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd098b838-c6, col_values=(('external_ids', {'iface-id': 'd098b838-c6bc-49e1-9021-293a1b527c93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:59:0d', 'vm-uuid': '77ef017e-9905-491a-9def-b81e289ac07b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:46 user nova-compute[75409]: INFO os_vif [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6')
Nov 15 21:24:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:24:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No VIF found with MAC fa:16:3e:c5:59:0d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:24:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updated VIF entry in instance network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-77678f37-0272-4fb3-82a7-827b94b52e90 req-6e0b51ad-68ee-483a-951b-9706d397fbf2 service nova] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Successfully updated port: 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing instance network info cache due to event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:24:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance network_info: |[{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start _get_guest_xml network_info=[{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:24:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1024966487',display_name='tempest-ServerStableDeviceRescueTest-server-1024966487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1024966487',id=3,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1w3IwZQuzhmYOZjDB4CqzB1nMbLgLze4h5chIWpKA4h1n2nTIX0cJ63BLH/trwf5U0b+0WEPiz8w1cfw9G1Qlei7+sz4fsrvhsxZbXV12IkJeUKMyv1vf8JHbr5WdKLA==',key_name='tempest-keypair-1226690818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d175092693d4075a673abd4700224b4',ramdisk_id='',reservation_id='r-l0an1ygs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1415887716',owner_user_name='tempest-ServerStableDeviceRescueTest-1415887716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc1671b61544734b8af9c67182684ad',uuid=c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converting VIF {"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:24:49 user nova-compute[75409]:   <uuid>c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</uuid>
Nov 15 21:24:49 user nova-compute[75409]:   <name>instance-00000003</name>
Nov 15 21:24:49 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:24:49 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:24:49 user nova-compute[75409]:   <metadata>
Nov 15 21:24:49 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:24:49 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1024966487</nova:name>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:24:49</nova:creationTime>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:24:49 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:24:49 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:owner>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:user uuid="4dc1671b61544734b8af9c67182684ad">tempest-ServerStableDeviceRescueTest-1415887716-project-member</nova:user>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:project uuid="6d175092693d4075a673abd4700224b4">tempest-ServerStableDeviceRescueTest-1415887716</nova:project>
Nov 15 21:24:49 user nova-compute[75409]:       </nova:owner>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:24:49 user nova-compute[75409]:       <nova:ports>
Nov 15 21:24:49 user nova-compute[75409]:         <nova:port uuid="35d82c8f-3046-4e3b-85ba-ba91853e4cb5">
Nov 15 21:24:49 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:24:49 user nova-compute[75409]:         </nova:port>
Nov 15 21:24:49 user nova-compute[75409]:       </nova:ports>
Nov 15 21:24:49 user nova-compute[75409]:     </nova:instance>
Nov 15 21:24:49 user nova-compute[75409]:   </metadata>
Nov 15 21:24:49 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:24:49 user nova-compute[75409]:     <system>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="serial">c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</entry>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="uuid">c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</entry>
Nov 15 21:24:49 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:24:49 user nova-compute[75409]:     </system>
Nov 15 21:24:49 user nova-compute[75409]:   </sysinfo>
Nov 15 21:24:49 user nova-compute[75409]:   <os>
Nov 15 21:24:49 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:24:49 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:24:49 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:24:49 user nova-compute[75409]:   </os>
Nov 15 21:24:49 user nova-compute[75409]:   <features>
Nov 15 21:24:49 user nova-compute[75409]:     <acpi/>
Nov 15 21:24:49 user nova-compute[75409]:     <apic/>
Nov 15 21:24:49 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:24:49 user nova-compute[75409]:   </features>
Nov 15 21:24:49 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:24:49 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:24:49 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:24:49 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:24:49 user nova-compute[75409]:   </clock>
Nov 15 21:24:49 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:24:49 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:24:49 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:24:49 user nova-compute[75409]:   </cpu>
Nov 15 21:24:49 user nova-compute[75409]:   <devices>
Nov 15 21:24:49 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:24:49 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:24:49 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk"/>
Nov 15 21:24:49 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:24:49 user nova-compute[75409]:     </disk>
Nov 15 21:24:49 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:24:49 user nova-compute[75409]:       <mac address="fa:16:3e:82:40:c6"/>
Nov 15 21:24:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:49 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:24:49 user nova-compute[75409]:       <target dev="tap35d82c8f-30"/>
Nov 15 21:24:49 user nova-compute[75409]:     </interface>
Nov 15 21:24:49 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:24:49 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/console.log" append="off"/>
Nov 15 21:24:49 user nova-compute[75409]:     </serial>
Nov 15 21:24:49 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:24:49 user nova-compute[75409]:     <video>
Nov 15 21:24:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:24:49 user nova-compute[75409]:     </video>
Nov 15 21:24:49 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:24:49 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:24:49 user nova-compute[75409]:     </rng>
Nov 15 21:24:49 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:24:49 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:24:49 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:24:49 user nova-compute[75409]:     </memballoon>
Nov 15 21:24:49 user nova-compute[75409]:   </devices>
Nov 15 21:24:49 user nova-compute[75409]: </domain>
Nov 15 21:24:49 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1024966487',display_name='tempest-ServerStableDeviceRescueTest-server-1024966487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1024966487',id=3,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1w3IwZQuzhmYOZjDB4CqzB1nMbLgLze4h5chIWpKA4h1n2nTIX0cJ63BLH/trwf5U0b+0WEPiz8w1cfw9G1Qlei7+sz4fsrvhsxZbXV12IkJeUKMyv1vf8JHbr5WdKLA==',key_name='tempest-keypair-1226690818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d175092693d4075a673abd4700224b4',ramdisk_id='',reservation_id='r-l0an1ygs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1415887716',owner_user_name='tempest-ServerStableDeviceRescueTest-1415887716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc1671b61544734b8af9c67182684ad',uuid=c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converting VIF {"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG os_vif [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ee030b7-9e6c-529f-87fd-9f6e4ee64727', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d82c8f-30, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35d82c8f-30, col_values=(('qos', UUID('2adcd2cb-bf11-4bf7-9f86-5054d5bbcbb9')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35d82c8f-30, col_values=(('external_ids', {'iface-id': '35d82c8f-3046-4e3b-85ba-ba91853e4cb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:40:c6', 'vm-uuid': 'c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:49 user nova-compute[75409]: INFO os_vif [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30')
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:24:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No VIF found with MAC fa:16:3e:82:40:c6, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:24:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated VIF entry in instance network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:24:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36f6d654-69c2-4ca8-b802-34fab00df5ac req-92078810-1848-4b5c-bcdf-88d2002ada54 service nova] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:24:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance spawned successfully.
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:51 user nova-compute[75409]: INFO nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Took 11.84 seconds to spawn the instance on the hypervisor.
Nov 15 21:24:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:24:51 user nova-compute[75409]: INFO nova.compute.manager [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Took 13.02 seconds to build instance.
Nov 15 21:24:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74ef9248-d62e-45f4-b370-6ad38a15eaef tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.152s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] No waiting events found dispatching network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:24:53 user nova-compute[75409]: WARNING nova.compute.manager [req-e10f2494-c576-4c9a-a0de-bf207b36bd80 req-d49277a2-63d3-4908-9b68-c7c7ca709624 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received unexpected event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 for instance with vm_state active and task_state None.
Nov 15 21:24:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:24:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance spawned successfully.
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:54 user nova-compute[75409]: INFO nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 15 21:24:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:24:54 user nova-compute[75409]: INFO nova.compute.manager [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Took 10.78 seconds to build instance.
Nov 15 21:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a61f8fb4-dd8a-4aaf-bd3d-6965aa5f2836 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.052s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:24:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] No waiting events found dispatching network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:24:55 user nova-compute[75409]: WARNING nova.compute.manager [req-fa176d30-dad0-4bcf-b59e-011b2efaa593 req-638a5acd-312b-474d-af52-9c7b8ec857cb service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received unexpected event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 for instance with vm_state active and task_state None.
Nov 15 21:24:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:24:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:00 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:00 user nova-compute[75409]: INFO nova.compute.claims [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Claim successful on node user
Nov 15 21:25:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:01 user nova-compute[75409]: WARNING nova.compute.manager [req-f490f43c-0236-4dfd-a050-91c7a8fea9a6 req-85427863-28d9-4a73-8a11-e8666472ebb9 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state active and task_state None.
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.policy [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd6a355fb5c64dc183bd8160e4a6c069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a443c99705304bdea61ec997b4e4b2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Creating image(s)
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "/opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "/opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "/opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.235s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk 1073741824" returned: 0 in 0.067s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.309s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Cannot resize image /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Ensure instance console log exists: /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Successfully created port: 112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:03 user nova-compute[75409]: WARNING nova.compute.manager [req-4feb3d91-571c-433a-b9a2-f75c8ab73705 req-dad6c396-a8ac-4da6-acd7-dcf56cabe0ad service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state active and task_state None.
Nov 15 21:25:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Successfully updated port: 112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquired lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-changed-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Refreshing instance network info cache due to event network-changed-112a5b2a-327a-43a2-848f-4c2962b305b4. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] Acquiring lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:04 user nova-compute[75409]: INFO nova.compute.claims [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Claim successful on node user
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating instance_info_cache with network_info: [{"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Releasing lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Instance network_info: |[{"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] Acquired lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.network.neutron [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Refreshing network info cache for port 112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Start _get_guest_xml network_info=[{"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1603878301',display_name='tempest-TestVolumeSwap-server-1603878301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1603878301',id=4,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERB0CZwyoPU6qYfFJy4z64/Hxt1Kq0IA3yNbrp6dY+rXThRtwiSDaGLaAibQd0plluA7ewvNP3LOEE4fcp+78I9FLk1wrVsCVRqUDdqrjqxRTgh6vf7X7yqXhCgI/9csg==',key_name='tempest-keypair-1361528540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a443c99705304bdea61ec997b4e4b2a9',ramdisk_id='',reservation_id='r-cgpx4fks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-991569155',owner_user_name='tempest-TestVolumeSwap-991569155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd6a355fb5c64dc183bd8160e4a6c069',uuid=498533a9-85ff-4309-bd4c-c97fb406aad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converting VIF {"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lazy-loading 'pci_devices' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.policy [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa0ba006f108414a9ffdf717199eb4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52c16742b045bbb5416024054f062c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Creating image(s)
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:05 user nova-compute[75409]:   <uuid>498533a9-85ff-4309-bd4c-c97fb406aad0</uuid>
Nov 15 21:25:05 user nova-compute[75409]:   <name>instance-00000004</name>
Nov 15 21:25:05 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:05 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:05 user nova-compute[75409]:   <metadata>
Nov 15 21:25:05 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:05 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:name>tempest-TestVolumeSwap-server-1603878301</nova:name>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:04</nova:creationTime>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:05 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:05 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:user uuid="dd6a355fb5c64dc183bd8160e4a6c069">tempest-TestVolumeSwap-991569155-project-member</nova:user>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:project uuid="a443c99705304bdea61ec997b4e4b2a9">tempest-TestVolumeSwap-991569155</nova:project>
Nov 15 21:25:05 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:05 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:05 user nova-compute[75409]:         <nova:port uuid="112a5b2a-327a-43a2-848f-4c2962b305b4">
Nov 15 21:25:05 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:25:05 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:05 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:05 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:05 user nova-compute[75409]:   </metadata>
Nov 15 21:25:05 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:05 user nova-compute[75409]:     <system>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="serial">498533a9-85ff-4309-bd4c-c97fb406aad0</entry>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="uuid">498533a9-85ff-4309-bd4c-c97fb406aad0</entry>
Nov 15 21:25:05 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:05 user nova-compute[75409]:     </system>
Nov 15 21:25:05 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:05 user nova-compute[75409]:   <os>
Nov 15 21:25:05 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:05 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:05 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:05 user nova-compute[75409]:   </os>
Nov 15 21:25:05 user nova-compute[75409]:   <features>
Nov 15 21:25:05 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:05 user nova-compute[75409]:     <apic/>
Nov 15 21:25:05 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:05 user nova-compute[75409]:   </features>
Nov 15 21:25:05 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:05 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:05 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:05 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:05 user nova-compute[75409]:   </clock>
Nov 15 21:25:05 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:05 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:05 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:05 user nova-compute[75409]:   </cpu>
Nov 15 21:25:05 user nova-compute[75409]:   <devices>
Nov 15 21:25:05 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:05 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:05 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk"/>
Nov 15 21:25:05 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:05 user nova-compute[75409]:     </disk>
Nov 15 21:25:05 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:05 user nova-compute[75409]:       <mac address="fa:16:3e:0e:ab:2c"/>
Nov 15 21:25:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:05 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:05 user nova-compute[75409]:       <target dev="tap112a5b2a-32"/>
Nov 15 21:25:05 user nova-compute[75409]:     </interface>
Nov 15 21:25:05 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:05 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/console.log" append="off"/>
Nov 15 21:25:05 user nova-compute[75409]:     </serial>
Nov 15 21:25:05 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:05 user nova-compute[75409]:     <video>
Nov 15 21:25:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:05 user nova-compute[75409]:     </video>
Nov 15 21:25:05 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:05 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:05 user nova-compute[75409]:     </rng>
Nov 15 21:25:05 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:05 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:05 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:05 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:05 user nova-compute[75409]:   </devices>
Nov 15 21:25:05 user nova-compute[75409]: </domain>
Nov 15 21:25:05 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1603878301',display_name='tempest-TestVolumeSwap-server-1603878301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1603878301',id=4,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERB0CZwyoPU6qYfFJy4z64/Hxt1Kq0IA3yNbrp6dY+rXThRtwiSDaGLaAibQd0plluA7ewvNP3LOEE4fcp+78I9FLk1wrVsCVRqUDdqrjqxRTgh6vf7X7yqXhCgI/9csg==',key_name='tempest-keypair-1361528540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a443c99705304bdea61ec997b4e4b2a9',ramdisk_id='',reservation_id='r-cgpx4fks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-991569155',owner_user_name='tempest-TestVolumeSwap-991569155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd6a355fb5c64dc183bd8160e4a6c069',uuid=498533a9-85ff-4309-bd4c-c97fb406aad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converting VIF {"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG os_vif [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84b3304b-35f1-5f30-8811-d895da8b5377', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112a5b2a-32, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112a5b2a-32, col_values=(('qos', UUID('0b37f308-0960-402a-9333-73762afabcef')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112a5b2a-32, col_values=(('external_ids', {'iface-id': '112a5b2a-327a-43a2-848f-4c2962b305b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ab:2c', 'vm-uuid': '498533a9-85ff-4309-bd4c-c97fb406aad0'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: INFO os_vif [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32')
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] No VIF found with MAC fa:16:3e:0e:ab:2c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.220s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updated VIF entry in instance network info cache for port 112a5b2a-327a-43a2-848f-4c2962b305b4. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating instance_info_cache with network_info: [{"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee693cd3-348b-4c13-befa-cd7caec2bc22 req-11bf5289-2d7e-4f2f-b0f7-988cdae0d806 service nova] Releasing lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Cannot resize image /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Ensure instance console log exists: /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Successfully created port: 2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Successfully updated port: 2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-changed-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing instance network info cache due to event network-changed-2c2af0a6-959e-49c1-9e44-5eebe90e5636. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Instance network_info: |[{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing network info cache for port 2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Start _get_guest_xml network_info=[{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'pci_devices' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:07 user nova-compute[75409]:   <uuid>43bc3403-fc31-4527-8d38-1138e3f7bf8c</uuid>
Nov 15 21:25:07 user nova-compute[75409]:   <name>instance-00000005</name>
Nov 15 21:25:07 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:07 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:07 user nova-compute[75409]:   <metadata>
Nov 15 21:25:07 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:07 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:07</nova:creationTime>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:07 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:07 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:25:07 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:07 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:07 user nova-compute[75409]:         <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:25:07 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:25:07 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:07 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:07 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:07 user nova-compute[75409]:   </metadata>
Nov 15 21:25:07 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:07 user nova-compute[75409]:     <system>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="serial">43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="uuid">43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:25:07 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:07 user nova-compute[75409]:     </system>
Nov 15 21:25:07 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:07 user nova-compute[75409]:   <os>
Nov 15 21:25:07 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:07 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:07 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:07 user nova-compute[75409]:   </os>
Nov 15 21:25:07 user nova-compute[75409]:   <features>
Nov 15 21:25:07 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:07 user nova-compute[75409]:     <apic/>
Nov 15 21:25:07 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:07 user nova-compute[75409]:   </features>
Nov 15 21:25:07 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:07 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:07 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:07 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:07 user nova-compute[75409]:   </clock>
Nov 15 21:25:07 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:07 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:07 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:07 user nova-compute[75409]:   </cpu>
Nov 15 21:25:07 user nova-compute[75409]:   <devices>
Nov 15 21:25:07 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:07 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:07 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk"/>
Nov 15 21:25:07 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:07 user nova-compute[75409]:     </disk>
Nov 15 21:25:07 user nova-compute[75409]:     <disk type="file" device="cdrom">
Nov 15 21:25:07 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 21:25:07 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config"/>
Nov 15 21:25:07 user nova-compute[75409]:       <target dev="hda" bus="ide"/>
Nov 15 21:25:07 user nova-compute[75409]:     </disk>
Nov 15 21:25:07 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:07 user nova-compute[75409]:       <mac address="fa:16:3e:a1:21:08"/>
Nov 15 21:25:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:07 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:07 user nova-compute[75409]:       <target dev="tap2c2af0a6-95"/>
Nov 15 21:25:07 user nova-compute[75409]:     </interface>
Nov 15 21:25:07 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:07 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log" append="off"/>
Nov 15 21:25:07 user nova-compute[75409]:     </serial>
Nov 15 21:25:07 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:07 user nova-compute[75409]:     <video>
Nov 15 21:25:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:07 user nova-compute[75409]:     </video>
Nov 15 21:25:07 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:07 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:07 user nova-compute[75409]:     </rng>
Nov 15 21:25:07 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:07 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:07 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:07 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:07 user nova-compute[75409]:   </devices>
Nov 15 21:25:07 user nova-compute[75409]: </domain>
Nov 15 21:25:07 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG os_vif [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8963783e-3a20-5310-ae29-cce6bfce370e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2af0a6-95, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c2af0a6-95, col_values=(('qos', UUID('c5eb72ec-fc4c-4090-ad57-6816d17ec3be')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c2af0a6-95, col_values=(('external_ids', {'iface-id': '2c2af0a6-959e-49c1-9e44-5eebe90e5636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:21:08', 'vm-uuid': '43bc3403-fc31-4527-8d38-1138e3f7bf8c'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:07 user nova-compute[75409]: INFO os_vif [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95')
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name hda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No VIF found with MAC fa:16:3e:a1:21:08, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Using config drive
Nov 15 21:25:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:08 user nova-compute[75409]: WARNING nova.compute.manager [req-f3cb92d8-9bc2-445c-81be-65f3b466a485 req-5e3c4369-135a-41c9-9e6a-98ffbe5dfa71 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state None.
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.network.neutron [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updated VIF entry in instance network info cache for port 2c2af0a6-959e-49c1-9e44-5eebe90e5636. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG nova.network.neutron [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c6dc9e29-38d1-4509-ad60-5ee6f86dcfd1 req-eab8b877-4cdb-4b83-80c8-d1cb6853c122 service nova] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Creating config drive at /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6paa1gyl {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6paa1gyl" returned: 0 in 0.061s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Instance spawned successfully.
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:09 user nova-compute[75409]: INFO nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:09 user nova-compute[75409]: INFO nova.compute.manager [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Took 8.83 seconds to build instance.
Nov 15 21:25:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cdf5232e-7888-4255-a301-d9321404ef54 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.017s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:10 user nova-compute[75409]: WARNING nova.compute.manager [req-7805fe05-9625-43f3-8e01-b694338000b2 req-c486ef99-5c4c-4fd7-99de-b2610d867275 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state None.
Nov 15 21:25:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:10 user nova-compute[75409]: INFO nova.compute.claims [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Claim successful on node user
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:11 user nova-compute[75409]: WARNING nova.compute.manager [req-1ac345ac-0583-4d03-b7a9-b14a6c6565c7 req-e1095726-7c9c-4742-99d6-69103dec4ecf service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 for instance with vm_state building and task_state spawning.
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Creating image(s)
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "/opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "/opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG nova.policy [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50fdaf3b48b140e4a35b9311af7fb33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ca9b1921524a139d5e1a45a92034b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.207s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk 1073741824" returned: 0 in 0.051s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Cannot resize image /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Ensure instance console log exists: /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Instance spawned successfully.
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:13 user nova-compute[75409]: WARNING nova.compute.manager [req-8a67dd78-d8f6-4c60-a580-62c20cfdcd37 req-311ccca5-722b-43bf-9b2b-dcd0209a8eef service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 for instance with vm_state building and task_state spawning.
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Successfully created port: d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:13 user nova-compute[75409]: INFO nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Took 8.35 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:13 user nova-compute[75409]: INFO nova.compute.manager [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Took 9.23 seconds to build instance.
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9fec442b-d570-4886-b837-9c23d3f450a0 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.370s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:13 user nova-compute[75409]: INFO nova.compute.claims [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Claim successful on node user
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Successfully updated port: d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquired lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.861s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.policy [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2612ed7971eb4b28966e02093c1eceeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7535d0ebae4485c9252ad6909720f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Creating image(s)
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating instance_info_cache with network_info: [{"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Releasing lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Instance network_info: |[{"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Start _get_guest_xml network_info=[{"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:14 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:14 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:14 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1423469874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1423469874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1423469874',id=6,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwlj5ORrKaIvMSme1uDlfI+cDglXkQ/DlC7P4c6O91yt5+ktXHmWWBpZ4lAtyK9SCOh2RJPncxFE/63oxtpE+FLiF0I6WfRIl8yuq9UFXvDXj8T845cHLPxl08CqvL6cw==',key_name='tempest-keypair-948153459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ca9b1921524a139d5e1a45a92034b9',ramdisk_id='',reservation_id='r-28np5ixw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1136349916',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1136349916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fdaf3b48b140e4a35b9311af7fb33f',uuid=6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converting VIF {"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:15 user nova-compute[75409]:   <uuid>6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2</uuid>
Nov 15 21:25:15 user nova-compute[75409]:   <name>instance-00000006</name>
Nov 15 21:25:15 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:15 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:15 user nova-compute[75409]:   <metadata>
Nov 15 21:25:15 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:15 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1423469874</nova:name>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:14</nova:creationTime>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:15 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:15 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:user uuid="50fdaf3b48b140e4a35b9311af7fb33f">tempest-VolumesAssistedSnapshotsTest-1136349916-project-member</nova:user>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:project uuid="07ca9b1921524a139d5e1a45a92034b9">tempest-VolumesAssistedSnapshotsTest-1136349916</nova:project>
Nov 15 21:25:15 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:15 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:15 user nova-compute[75409]:         <nova:port uuid="d046b4ac-8f50-4795-b3b4-9336cfc74bf1">
Nov 15 21:25:15 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:25:15 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:15 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:15 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:15 user nova-compute[75409]:   </metadata>
Nov 15 21:25:15 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:15 user nova-compute[75409]:     <system>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="serial">6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2</entry>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="uuid">6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2</entry>
Nov 15 21:25:15 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:15 user nova-compute[75409]:     </system>
Nov 15 21:25:15 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:15 user nova-compute[75409]:   <os>
Nov 15 21:25:15 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:15 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:15 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:15 user nova-compute[75409]:   </os>
Nov 15 21:25:15 user nova-compute[75409]:   <features>
Nov 15 21:25:15 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:15 user nova-compute[75409]:     <apic/>
Nov 15 21:25:15 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:15 user nova-compute[75409]:   </features>
Nov 15 21:25:15 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:15 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:15 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:15 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:15 user nova-compute[75409]:   </clock>
Nov 15 21:25:15 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:15 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:15 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:15 user nova-compute[75409]:   </cpu>
Nov 15 21:25:15 user nova-compute[75409]:   <devices>
Nov 15 21:25:15 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:15 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:15 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk"/>
Nov 15 21:25:15 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:15 user nova-compute[75409]:     </disk>
Nov 15 21:25:15 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:15 user nova-compute[75409]:       <mac address="fa:16:3e:9e:80:66"/>
Nov 15 21:25:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:15 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:15 user nova-compute[75409]:       <target dev="tapd046b4ac-8f"/>
Nov 15 21:25:15 user nova-compute[75409]:     </interface>
Nov 15 21:25:15 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:15 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/console.log" append="off"/>
Nov 15 21:25:15 user nova-compute[75409]:     </serial>
Nov 15 21:25:15 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:15 user nova-compute[75409]:     <video>
Nov 15 21:25:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:15 user nova-compute[75409]:     </video>
Nov 15 21:25:15 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:15 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:15 user nova-compute[75409]:     </rng>
Nov 15 21:25:15 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:15 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:15 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:15 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:15 user nova-compute[75409]:   </devices>
Nov 15 21:25:15 user nova-compute[75409]: </domain>
Nov 15 21:25:15 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1423469874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1423469874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1423469874',id=6,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwlj5ORrKaIvMSme1uDlfI+cDglXkQ/DlC7P4c6O91yt5+ktXHmWWBpZ4lAtyK9SCOh2RJPncxFE/63oxtpE+FLiF0I6WfRIl8yuq9UFXvDXj8T845cHLPxl08CqvL6cw==',key_name='tempest-keypair-948153459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ca9b1921524a139d5e1a45a92034b9',ramdisk_id='',reservation_id='r-28np5ixw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1136349916',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1136349916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fdaf3b48b140e4a35b9311af7fb33f',uuid=6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converting VIF {"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG os_vif [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-changed-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Refreshing instance network info cache due to event network-changed-d046b4ac-8f50-4795-b3b4-9336cfc74bf1. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] Acquiring lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] Acquired lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Refreshing network info cache for port d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feb44afa-1b8e-5b8e-9c6e-f1f4ad54fd87', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd046b4ac-8f, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd046b4ac-8f, col_values=(('qos', UUID('5900c624-2449-4eb5-9454-40802d84dc69')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd046b4ac-8f, col_values=(('external_ids', {'iface-id': 'd046b4ac-8f50-4795-b3b4-9336cfc74bf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:80:66', 'vm-uuid': '6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:15 user nova-compute[75409]: INFO os_vif [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f')
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] No VIF found with MAC fa:16:3e:9e:80:66, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.part --force-share --output=json" returned: 0 in 0.273s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.virt.images [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] eebd53c3-6230-49d5-8153-61b25b39b74f was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:25:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.part /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Successfully created port: 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.part /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.converted" returned: 0 in 0.632s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updated VIF entry in instance network info cache for port d046b4ac-8f50-4795-b3b4-9336cfc74bf1. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating instance_info_cache with network_info: [{"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b.converted --force-share --output=json" returned: 0 in 0.314s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.975s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8d0eed7-026a-45ae-96a0-f04a4db28620 req-a022e2eb-ec3d-4155-8bad-1c58e446ae0e service nova] Releasing lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json" returned: 0 in 0.217s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b,backing_fmt=raw /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b,backing_fmt=raw /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk 1073741824" returned: 0 in 0.081s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "cf6a48d7051f8012b02faef5ec5d2190cb11473b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json" returned: 0 in 0.304s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Cannot resize image /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Ensure instance console log exists: /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] No waiting events found dispatching network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:18 user nova-compute[75409]: WARNING nova.compute.manager [req-3b67e2b4-dd20-4eda-9ed3-ecf6c7526aa0 req-bca6b9bd-a686-4c82-8289-1947ed0a6bda service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received unexpected event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 for instance with vm_state building and task_state spawning.
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Successfully updated port: 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing instance network info cache due to event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:19 user nova-compute[75409]: INFO nova.compute.claims [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Claim successful on node user
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance network_info: |[{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start _get_guest_xml network_info=[{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:25:08Z,direct_url=<?>,disk_format='qcow2',id=eebd53c3-6230-49d5-8153-61b25b39b74f,min_disk=0,min_ram=0,name='tempest-scenario-img--620545964',owner='e7535d0ebae4485c9252ad6909720f5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'eebd53c3-6230-49d5-8153-61b25b39b74f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:25:08Z,direct_url=<?>,disk_format='qcow2',id=eebd53c3-6230-49d5-8153-61b25b39b74f,min_disk=0,min_ram=0,name='tempest-scenario-img--620545964',owner='e7535d0ebae4485c9252ad6909720f5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:15Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.objects.instance [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'pci_devices' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:19 user nova-compute[75409]:   <uuid>bac6908e-d641-439c-bb4c-8a86352bb9d9</uuid>
Nov 15 21:25:19 user nova-compute[75409]:   <name>instance-00000007</name>
Nov 15 21:25:19 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:19 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:19 user nova-compute[75409]:   <metadata>
Nov 15 21:25:19 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:19 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:name>tempest-TestMinimumBasicScenario-server-1600133315</nova:name>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:19</nova:creationTime>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:19 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:19 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:user uuid="2612ed7971eb4b28966e02093c1eceeb">tempest-TestMinimumBasicScenario-998083421-project-member</nova:user>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:project uuid="e7535d0ebae4485c9252ad6909720f5f">tempest-TestMinimumBasicScenario-998083421</nova:project>
Nov 15 21:25:19 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:root type="image" uuid="eebd53c3-6230-49d5-8153-61b25b39b74f"/>
Nov 15 21:25:19 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:19 user nova-compute[75409]:         <nova:port uuid="6464f2cb-6c06-4c15-ab77-8887d3e29593">
Nov 15 21:25:19 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:25:19 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:19 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:19 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:19 user nova-compute[75409]:   </metadata>
Nov 15 21:25:19 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:19 user nova-compute[75409]:     <system>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="serial">bac6908e-d641-439c-bb4c-8a86352bb9d9</entry>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="uuid">bac6908e-d641-439c-bb4c-8a86352bb9d9</entry>
Nov 15 21:25:19 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:19 user nova-compute[75409]:     </system>
Nov 15 21:25:19 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:19 user nova-compute[75409]:   <os>
Nov 15 21:25:19 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:19 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:19 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:19 user nova-compute[75409]:   </os>
Nov 15 21:25:19 user nova-compute[75409]:   <features>
Nov 15 21:25:19 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:19 user nova-compute[75409]:     <apic/>
Nov 15 21:25:19 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:19 user nova-compute[75409]:   </features>
Nov 15 21:25:19 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:19 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:19 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:19 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:19 user nova-compute[75409]:   </clock>
Nov 15 21:25:19 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:19 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:19 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:19 user nova-compute[75409]:   </cpu>
Nov 15 21:25:19 user nova-compute[75409]:   <devices>
Nov 15 21:25:19 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:19 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:19 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk"/>
Nov 15 21:25:19 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:19 user nova-compute[75409]:     </disk>
Nov 15 21:25:19 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:19 user nova-compute[75409]:       <mac address="fa:16:3e:b8:6a:ed"/>
Nov 15 21:25:19 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:19 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:19 user nova-compute[75409]:       <target dev="tap6464f2cb-6c"/>
Nov 15 21:25:19 user nova-compute[75409]:     </interface>
Nov 15 21:25:19 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:19 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/console.log" append="off"/>
Nov 15 21:25:19 user nova-compute[75409]:     </serial>
Nov 15 21:25:19 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:19 user nova-compute[75409]:     <video>
Nov 15 21:25:19 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:19 user nova-compute[75409]:     </video>
Nov 15 21:25:19 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:19 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:19 user nova-compute[75409]:     </rng>
Nov 15 21:25:19 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:19 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:19 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:19 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:19 user nova-compute[75409]:   </devices>
Nov 15 21:25:19 user nova-compute[75409]: </domain>
Nov 15 21:25:19 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:15Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG os_vif [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b87fbff8-e163-5073-831b-0632709d9130', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6464f2cb-6c, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6464f2cb-6c, col_values=(('qos', UUID('879b4f45-51cb-414c-8486-fbf6843d6c3f')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6464f2cb-6c, col_values=(('external_ids', {'iface-id': '6464f2cb-6c06-4c15-ab77-8887d3e29593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:6a:ed', 'vm-uuid': 'bac6908e-d641-439c-bb4c-8a86352bb9d9'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:19 user nova-compute[75409]: INFO os_vif [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c')
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No VIF found with MAC fa:16:3e:b8:6a:ed, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:19 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] No waiting events found dispatching network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:20 user nova-compute[75409]: WARNING nova.compute.manager [req-fbba3621-dba2-4bfa-887a-86d87377f682 req-c312b2a6-426b-45d4-b328-f18577a62e46 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received unexpected event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 for instance with vm_state building and task_state spawning.
Nov 15 21:25:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated VIF entry in instance network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-75756f9e-7d1e-4e24-a13c-aeb84a2b1dda req-e32f0c05-65ff-4826-9058-3d22ce6f57fb service nova] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.policy [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6479c6d2dc1f44889c7a1e82127f2861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de94f4eaef4d4c7db28a68c8c55db25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Instance spawned successfully.
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Creating image(s)
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "/opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "/opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "/opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:20 user nova-compute[75409]: INFO nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Took 8.90 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.295s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:20 user nova-compute[75409]: INFO nova.compute.manager [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Took 10.32 seconds to build instance.
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2036a8ef-3e36-43d1-889e-a5ccb7cc8b3e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.803s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.277s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Successfully created port: 358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Cannot resize image /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Ensure instance console log exists: /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] No waiting events found dispatching network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:22 user nova-compute[75409]: WARNING nova.compute.manager [req-b941de7b-27fa-46ba-b5ca-b7da7c796bde req-336038e8-af5e-480a-9818-5c86d37bb5a0 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received unexpected event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 for instance with vm_state active and task_state None.
Nov 15 21:25:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Successfully updated port: 358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquired lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-changed-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Refreshing instance network info cache due to event network-changed-358fee58-f98d-4510-8602-f6f1545c1625. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] Acquiring lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.network.neutron [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Updating instance_info_cache with network_info: [{"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Releasing lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Instance network_info: |[{"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] Acquired lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.network.neutron [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Refreshing network info cache for port 358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Start _get_guest_xml network_info=[{"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:24 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:24 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406813183',display_name='tempest-VolumesActionsTest-instance-1406813183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406813183',id=8,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de94f4eaef4d4c7db28a68c8c55db25d',ramdisk_id='',reservation_id='r-rv706gd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1432516137',owner_user_name='tempest-VolumesActionsTest-1432516137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:20Z,user_data=None,user_id='6479c6d2dc1f44889c7a1e82127f2861',uuid=01938a2b-fd10-4e70-80a1-918fb2de1d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converting VIF {"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.objects.instance [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lazy-loading 'pci_devices' on Instance uuid 01938a2b-fd10-4e70-80a1-918fb2de1d58 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] No waiting events found dispatching network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:24 user nova-compute[75409]: WARNING nova.compute.manager [req-e603068e-5b8d-424f-8037-c0fbd2502832 req-dd6dae22-1cac-4a2b-b8cb-808f473d48e8 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received unexpected event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 for instance with vm_state active and task_state None.
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:24 user nova-compute[75409]:   <uuid>01938a2b-fd10-4e70-80a1-918fb2de1d58</uuid>
Nov 15 21:25:24 user nova-compute[75409]:   <name>instance-00000008</name>
Nov 15 21:25:24 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:24 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:24 user nova-compute[75409]:   <metadata>
Nov 15 21:25:24 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:24 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:name>tempest-VolumesActionsTest-instance-1406813183</nova:name>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:24</nova:creationTime>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:24 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:24 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:user uuid="6479c6d2dc1f44889c7a1e82127f2861">tempest-VolumesActionsTest-1432516137-project-member</nova:user>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:project uuid="de94f4eaef4d4c7db28a68c8c55db25d">tempest-VolumesActionsTest-1432516137</nova:project>
Nov 15 21:25:24 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:24 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:24 user nova-compute[75409]:         <nova:port uuid="358fee58-f98d-4510-8602-f6f1545c1625">
Nov 15 21:25:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:25:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:24 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:24 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:24 user nova-compute[75409]:   </metadata>
Nov 15 21:25:24 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:24 user nova-compute[75409]:     <system>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="serial">01938a2b-fd10-4e70-80a1-918fb2de1d58</entry>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="uuid">01938a2b-fd10-4e70-80a1-918fb2de1d58</entry>
Nov 15 21:25:24 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:24 user nova-compute[75409]:     </system>
Nov 15 21:25:24 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:24 user nova-compute[75409]:   <os>
Nov 15 21:25:24 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:24 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:24 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:24 user nova-compute[75409]:   </os>
Nov 15 21:25:24 user nova-compute[75409]:   <features>
Nov 15 21:25:24 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:24 user nova-compute[75409]:     <apic/>
Nov 15 21:25:24 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:24 user nova-compute[75409]:   </features>
Nov 15 21:25:24 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:24 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:24 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:24 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:24 user nova-compute[75409]:   </clock>
Nov 15 21:25:24 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:24 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:24 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:24 user nova-compute[75409]:   </cpu>
Nov 15 21:25:24 user nova-compute[75409]:   <devices>
Nov 15 21:25:24 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:24 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:24 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk"/>
Nov 15 21:25:24 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:24 user nova-compute[75409]:     </disk>
Nov 15 21:25:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:24 user nova-compute[75409]:       <mac address="fa:16:3e:03:29:2e"/>
Nov 15 21:25:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:24 user nova-compute[75409]:       <target dev="tap358fee58-f9"/>
Nov 15 21:25:24 user nova-compute[75409]:     </interface>
Nov 15 21:25:24 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:24 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/console.log" append="off"/>
Nov 15 21:25:24 user nova-compute[75409]:     </serial>
Nov 15 21:25:24 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:24 user nova-compute[75409]:     <video>
Nov 15 21:25:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:24 user nova-compute[75409]:     </video>
Nov 15 21:25:24 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:24 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:24 user nova-compute[75409]:     </rng>
Nov 15 21:25:24 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:24 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:24 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:24 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:24 user nova-compute[75409]:   </devices>
Nov 15 21:25:24 user nova-compute[75409]: </domain>
Nov 15 21:25:24 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406813183',display_name='tempest-VolumesActionsTest-instance-1406813183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406813183',id=8,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de94f4eaef4d4c7db28a68c8c55db25d',ramdisk_id='',reservation_id='r-rv706gd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1432516137',owner_user_name='tempest-VolumesActionsTest-1432516137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:20Z,user_data=None,user_id='6479c6d2dc1f44889c7a1e82127f2861',uuid=01938a2b-fd10-4e70-80a1-918fb2de1d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converting VIF {"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG os_vif [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7668a58f-05cc-5539-89c2-e538637857ff', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap358fee58-f9, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap358fee58-f9, col_values=(('qos', UUID('36309ab1-e87f-4f03-9340-dd702a25d99e')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap358fee58-f9, col_values=(('external_ids', {'iface-id': '358fee58-f98d-4510-8602-f6f1545c1625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:29:2e', 'vm-uuid': '01938a2b-fd10-4e70-80a1-918fb2de1d58'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:24 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance spawned successfully.
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:24 user nova-compute[75409]: INFO os_vif [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9')
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] No VIF found with MAC fa:16:3e:03:29:2e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:24 user nova-compute[75409]: INFO nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Took 9.62 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:24 user nova-compute[75409]: INFO nova.compute.manager [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Took 11.13 seconds to build instance.
Nov 15 21:25:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-872c8467-63f6-4fcd-a736-511567d4531e tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.272s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.neutron [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Updated VIF entry in instance network info cache for port 358fee58-f98d-4510-8602-f6f1545c1625. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG nova.network.neutron [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Updating instance_info_cache with network_info: [{"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-92f723f6-f5ce-4191-9737-75c743e27670 req-5b4af2d2-952d-42b0-ae06-c394486aed24 service nova] Releasing lock "refresh_cache-01938a2b-fd10-4e70-80a1-918fb2de1d58" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG nova.compute.manager [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG nova.compute.manager [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] No waiting events found dispatching network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:26 user nova-compute[75409]: WARNING nova.compute.manager [req-645b804e-2042-4f75-8d38-ce47120e7f30 req-9bd4f2d9-3291-4969-a79e-c653352a454e service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received unexpected event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 for instance with vm_state building and task_state spawning.
Nov 15 21:25:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:27 user nova-compute[75409]: WARNING nova.compute.manager [req-aa426d34-aac7-4895-a89f-0db1dfa2efa9 req-cb8b27fc-19e3-4e61-bdd2-76bb45db65fc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state None.
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Instance spawned successfully.
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:28 user nova-compute[75409]: INFO nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Took 8.31 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:28 user nova-compute[75409]: INFO nova.compute.manager [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Took 9.29 seconds to build instance.
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6fb6f925-3e7c-4a91-a249-28dac84b1b21 tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.405s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] No waiting events found dispatching network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:28 user nova-compute[75409]: WARNING nova.compute.manager [req-e4bb387c-887b-44d2-8150-5d6e9bd2c34c req-b3d23e1e-b3e8-4bcd-bf6a-45785b1e973f service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received unexpected event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 for instance with vm_state active and task_state None.
Nov 15 21:25:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:29 user nova-compute[75409]: WARNING nova.compute.manager [req-64f2d648-def0-4efa-beb1-b9a3df60444d req-da2f81fa-f460-446a-b232-fcd70e1bd8bc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state None.
Nov 15 21:25:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:25:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.558429718017578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ef0e75f6-944c-4960-8548-4de9db2e5655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77ef017e-9905-491a-9def-b81e289ac07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 498533a9-85ff-4309-bd4c-c97fb406aad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance bac6908e-d641-439c-bb4c-8a86352bb9d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01938a2b-fd10-4e70-80a1-918fb2de1d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:25:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.078s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:25:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid ef0e75f6-944c-4960-8548-4de9db2e5655 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:39 user nova-compute[75409]: INFO nova.compute.claims [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Claim successful on node user
Nov 15 21:25:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updating instance_info_cache with network_info: [{"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-ef0e75f6-944c-4960-8548-4de9db2e5655" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:25:39 user nova-compute[75409]: DEBUG nova.policy [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82b0b1a90e934557867cc74995860f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b6031968184be39b435bc6a0bd825e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:40 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Creating image(s)
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "/opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "/opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "/opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.220s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.199s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk 1073741824" returned: 0 in 0.054s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Cannot resize image /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Ensure instance console log exists: /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Successfully created port: 71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Successfully updated port: 71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquired lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-changed-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Refreshing instance network info cache due to event network-changed-71ccc38c-121a-45e1-85b0-694af41fac89. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] Acquiring lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating instance_info_cache with network_info: [{"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Releasing lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Instance network_info: |[{"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] Acquired lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.neutron [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Refreshing network info cache for port 71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Start _get_guest_xml network_info=[{"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-474524812',display_name='tempest-TestServerVolumeAttachmentScenario-server-474524812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-474524812',id=9,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO66HtQDin+w0UYWXfHCZWhjdSSXf3gDFBkHAOqkB0v1otiaWopjW98tiKvHjvsuIp4kxodWxrpWXZamOIfH7NIRddPZfGGRvbMbCXFnPAz+KY95iiAea2uCWyaz8TG76g==',key_name='tempest-keypair-1664206000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26b6031968184be39b435bc6a0bd825e',ramdisk_id='',reservation_id='r-3appsicn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1699042490',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1699042490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b0b1a90e934557867cc74995860f7e',uuid=0208271e-c742-4fb4-8ae8-1fe9907d677b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converting VIF {"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.objects.instance [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'pci_devices' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:43 user nova-compute[75409]:   <uuid>0208271e-c742-4fb4-8ae8-1fe9907d677b</uuid>
Nov 15 21:25:43 user nova-compute[75409]:   <name>instance-00000009</name>
Nov 15 21:25:43 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:43 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:43 user nova-compute[75409]:   <metadata>
Nov 15 21:25:43 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:43 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-474524812</nova:name>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:43</nova:creationTime>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:43 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:43 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:user uuid="82b0b1a90e934557867cc74995860f7e">tempest-TestServerVolumeAttachmentScenario-1699042490-project-member</nova:user>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:project uuid="26b6031968184be39b435bc6a0bd825e">tempest-TestServerVolumeAttachmentScenario-1699042490</nova:project>
Nov 15 21:25:43 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:43 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:43 user nova-compute[75409]:         <nova:port uuid="71ccc38c-121a-45e1-85b0-694af41fac89">
Nov 15 21:25:43 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 21:25:43 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:43 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:43 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:43 user nova-compute[75409]:   </metadata>
Nov 15 21:25:43 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:43 user nova-compute[75409]:     <system>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="serial">0208271e-c742-4fb4-8ae8-1fe9907d677b</entry>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="uuid">0208271e-c742-4fb4-8ae8-1fe9907d677b</entry>
Nov 15 21:25:43 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:43 user nova-compute[75409]:     </system>
Nov 15 21:25:43 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:43 user nova-compute[75409]:   <os>
Nov 15 21:25:43 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:43 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:43 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:43 user nova-compute[75409]:   </os>
Nov 15 21:25:43 user nova-compute[75409]:   <features>
Nov 15 21:25:43 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:43 user nova-compute[75409]:     <apic/>
Nov 15 21:25:43 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:43 user nova-compute[75409]:   </features>
Nov 15 21:25:43 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:43 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:43 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:43 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:43 user nova-compute[75409]:   </clock>
Nov 15 21:25:43 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:43 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:43 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:43 user nova-compute[75409]:   </cpu>
Nov 15 21:25:43 user nova-compute[75409]:   <devices>
Nov 15 21:25:43 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:43 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:43 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk"/>
Nov 15 21:25:43 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:43 user nova-compute[75409]:     </disk>
Nov 15 21:25:43 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:43 user nova-compute[75409]:       <mac address="fa:16:3e:f0:98:fd"/>
Nov 15 21:25:43 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:43 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:43 user nova-compute[75409]:       <target dev="tap71ccc38c-12"/>
Nov 15 21:25:43 user nova-compute[75409]:     </interface>
Nov 15 21:25:43 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:43 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/console.log" append="off"/>
Nov 15 21:25:43 user nova-compute[75409]:     </serial>
Nov 15 21:25:43 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:43 user nova-compute[75409]:     <video>
Nov 15 21:25:43 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:43 user nova-compute[75409]:     </video>
Nov 15 21:25:43 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:43 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:43 user nova-compute[75409]:     </rng>
Nov 15 21:25:43 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:43 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:43 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:43 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:43 user nova-compute[75409]:   </devices>
Nov 15 21:25:43 user nova-compute[75409]: </domain>
Nov 15 21:25:43 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-474524812',display_name='tempest-TestServerVolumeAttachmentScenario-server-474524812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-474524812',id=9,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO66HtQDin+w0UYWXfHCZWhjdSSXf3gDFBkHAOqkB0v1otiaWopjW98tiKvHjvsuIp4kxodWxrpWXZamOIfH7NIRddPZfGGRvbMbCXFnPAz+KY95iiAea2uCWyaz8TG76g==',key_name='tempest-keypair-1664206000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26b6031968184be39b435bc6a0bd825e',ramdisk_id='',reservation_id='r-3appsicn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1699042490',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1699042490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b0b1a90e934557867cc74995860f7e',uuid=0208271e-c742-4fb4-8ae8-1fe9907d677b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converting VIF {"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG os_vif [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e1fb8e5-bdc8-530b-9843-a8d09ac6c5b7', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71ccc38c-12, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71ccc38c-12, col_values=(('qos', UUID('b66aa6e6-03eb-499c-b80f-dc02ecd36562')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71ccc38c-12, col_values=(('external_ids', {'iface-id': '71ccc38c-121a-45e1-85b0-694af41fac89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:98:fd', 'vm-uuid': '0208271e-c742-4fb4-8ae8-1fe9907d677b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:43 user nova-compute[75409]: INFO os_vif [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12')
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No VIF found with MAC fa:16:3e:f0:98:fd, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:44 user nova-compute[75409]: DEBUG nova.network.neutron [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updated VIF entry in instance network info cache for port 71ccc38c-121a-45e1-85b0-694af41fac89. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:44 user nova-compute[75409]: DEBUG nova.network.neutron [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating instance_info_cache with network_info: [{"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f3b9ee4-da33-4fa4-871f-53396672a5b1 req-d7cf93f7-77a3-4ec1-99e3-0382cbbcd81f service nova] Releasing lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:45 user nova-compute[75409]: INFO nova.compute.claims [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Claim successful on node user
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:46 user nova-compute[75409]: INFO nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Booting with volume f83a21b7-9c42-49a9-b9a3-af51be173b09 at /dev/vda
Nov 15 21:25:46 user nova-compute[75409]: DEBUG nova.policy [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd095f7c953144aec82b4ea20dbbcdcc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69baabcae00c484aae8abcc1acbdaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:46 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:25:46 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwwf8ur5v/privsep.sock']
Nov 15 21:25:46 user sudo[86674]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwwf8ur5v/privsep.sock
Nov 15 21:25:46 user sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 21:25:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully created port: be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully created port: dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:25:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Instance spawned successfully.
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:25:47 user nova-compute[75409]: INFO nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:25:47 user nova-compute[75409]: INFO nova.compute.manager [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Took 8.54 seconds to build instance.
Nov 15 21:25:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-61263c02-0890-4690-970f-c560897bedaf tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.646s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:47 user sudo[86674]: pam_unix(sudo:session): session closed for user root
Nov 15 21:25:47 user nova-compute[75409]: INFO oslo.privsep.daemon [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Spawned new privsep daemon via rootwrap
Nov 15 21:25:47 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 21:25:47 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 21:25:47 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 21:25:47 user nova-compute[75409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86679
Nov 15 21:25:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully created port: 7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c09a2-4d3a-4856-a27b-0331022b3de3]: (2,) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b59e7c-ccaa-4331-9668-64cff0955028]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: WARNING os_brick.initiator.connectors.nvmeof [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475dfe6-61e7-4bd5-89a4-7f670cf412e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a130dd64-be27-4853-9bee-34638c6c20ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef086e7-4c73-462c-b175-68e2a00ab569]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:25:48 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:25:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd72a9-f9a8-4625-a126-57cd61a684b1]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== get_connector_properties: return (2004ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating existing volume attachment record: ff13e4eb-3f91-4ed7-aaff-b597bdf66258 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully created port: 7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully created port: d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-be06eaae-06be-4a7b-8fa3-caa1dca1917c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-054a73da-c842-49b5-98d7-7477bc0267e2 req-11012ce8-357b-4927-876e-f7375950ad7c service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: 2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:51 user nova-compute[75409]: WARNING nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state active and task_state None.
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-2137497b-7fbd-4bbc-b864-00d1abae473e. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port 2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG nova.network.neutron [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG nova.network.neutron [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:25:52 user nova-compute[75409]: WARNING nova.compute.manager [req-9de3b670-bf80-4a48-ba48-79e0478894a7 req-2a712505-1f71-4009-a4c2-9db99592b357 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state active and task_state None.
Nov 15 21:25:52 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: 7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:25:53 user nova-compute[75409]: INFO nova.compute.claims [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Claim successful on node user
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-7e99326a-2e70-4981-89c4-892e82abae98. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port 7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:25:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:25:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:25:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Creating image(s)
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "/opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "/opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.policy [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098f422f38cb4addab5b34395aac505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009284b3fdbd4f4ab5887b35b1fc56cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: 7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: INFO nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Booting with volume 1fb851e4-5923-4902-a52d-1ba92a864fe4 at /dev/vdb
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk 1073741824" returned: 0 in 0.054s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af29dd2-3b35-4100-a0bc-04d66335d695]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515f95b-0111-4472-bcbd-524783935e02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a432ec-0f6c-41e9-933d-fde3502b1cdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b47742e-0528-4604-8532-e952e0e1638e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:25:54 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0569fef-16b1-4457-868b-c49719995cd3]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating existing volume attachment record: 1665b019-f479-4519-bb6c-813df5b495da {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Cannot resize image /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Ensure instance console log exists: /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:25:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-dec4fb56-145e-43d2-9be4-c5d137983604. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Successfully created port: d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: 7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e8f81dd-bf01-4181-925e-d3716cd63243 req-947bd13f-03a8-4c45-bda8-db640abd1bdb service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-7c273184-82d1-4852-84bb-469230dc6348. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port 7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Successfully updated port: d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquired lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Successfully updated port: d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-7629e08f-74c1-41a2-907f-5d7b6b0b0baa. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port 7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updating instance_info_cache with network_info: [{"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Releasing lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Instance network_info: |[{"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Start _get_guest_xml network_info=[{"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:25:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2116039095',display_name='tempest-VolumesSnapshotTestJSON-instance-2116039095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2116039095',id=11,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3lTzizryWlzCdn9FSoOlR4KArK4o6ryEJKeCReMIGKjDUVRM8+fKOd6jvV5XFFWq8ze+S7iYMe3EDljzUk02hsPQg3XbHRV8mcJor9h93MDbJaY6uKUkG+IbJ8CJdmYg==',key_name='tempest-keypair-1112517365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-o5h7idug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=f3d16138-3e3e-4848-bfcd-d0273f300c86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'pci_devices' on Instance uuid f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:25:56 user nova-compute[75409]:   <uuid>f3d16138-3e3e-4848-bfcd-d0273f300c86</uuid>
Nov 15 21:25:56 user nova-compute[75409]:   <name>instance-0000000b</name>
Nov 15 21:25:56 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:25:56 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:25:56 user nova-compute[75409]:   <metadata>
Nov 15 21:25:56 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:25:56 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2116039095</nova:name>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:25:56</nova:creationTime>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:25:56 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:25:56 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:owner>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:user uuid="098f422f38cb4addab5b34395aac505a">tempest-VolumesSnapshotTestJSON-2115825168-project-member</nova:user>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:project uuid="009284b3fdbd4f4ab5887b35b1fc56cb">tempest-VolumesSnapshotTestJSON-2115825168</nova:project>
Nov 15 21:25:56 user nova-compute[75409]:       </nova:owner>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:25:56 user nova-compute[75409]:       <nova:ports>
Nov 15 21:25:56 user nova-compute[75409]:         <nova:port uuid="d37ff7cb-9750-44bc-976c-309de6f3d691">
Nov 15 21:25:56 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 21:25:56 user nova-compute[75409]:         </nova:port>
Nov 15 21:25:56 user nova-compute[75409]:       </nova:ports>
Nov 15 21:25:56 user nova-compute[75409]:     </nova:instance>
Nov 15 21:25:56 user nova-compute[75409]:   </metadata>
Nov 15 21:25:56 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:25:56 user nova-compute[75409]:     <system>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="serial">f3d16138-3e3e-4848-bfcd-d0273f300c86</entry>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="uuid">f3d16138-3e3e-4848-bfcd-d0273f300c86</entry>
Nov 15 21:25:56 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:25:56 user nova-compute[75409]:     </system>
Nov 15 21:25:56 user nova-compute[75409]:   </sysinfo>
Nov 15 21:25:56 user nova-compute[75409]:   <os>
Nov 15 21:25:56 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:25:56 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:25:56 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:25:56 user nova-compute[75409]:   </os>
Nov 15 21:25:56 user nova-compute[75409]:   <features>
Nov 15 21:25:56 user nova-compute[75409]:     <acpi/>
Nov 15 21:25:56 user nova-compute[75409]:     <apic/>
Nov 15 21:25:56 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:25:56 user nova-compute[75409]:   </features>
Nov 15 21:25:56 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:25:56 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:25:56 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:25:56 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:25:56 user nova-compute[75409]:   </clock>
Nov 15 21:25:56 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:25:56 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:25:56 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:25:56 user nova-compute[75409]:   </cpu>
Nov 15 21:25:56 user nova-compute[75409]:   <devices>
Nov 15 21:25:56 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:25:56 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:25:56 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk"/>
Nov 15 21:25:56 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:25:56 user nova-compute[75409]:     </disk>
Nov 15 21:25:56 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:25:56 user nova-compute[75409]:       <mac address="fa:16:3e:87:18:1c"/>
Nov 15 21:25:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:56 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:25:56 user nova-compute[75409]:       <target dev="tapd37ff7cb-97"/>
Nov 15 21:25:56 user nova-compute[75409]:     </interface>
Nov 15 21:25:56 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:25:56 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/console.log" append="off"/>
Nov 15 21:25:56 user nova-compute[75409]:     </serial>
Nov 15 21:25:56 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:25:56 user nova-compute[75409]:     <video>
Nov 15 21:25:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:25:56 user nova-compute[75409]:     </video>
Nov 15 21:25:56 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:25:56 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:25:56 user nova-compute[75409]:     </rng>
Nov 15 21:25:56 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:25:56 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:25:56 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:25:56 user nova-compute[75409]:     </memballoon>
Nov 15 21:25:56 user nova-compute[75409]:   </devices>
Nov 15 21:25:56 user nova-compute[75409]: </domain>
Nov 15 21:25:56 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2116039095',display_name='tempest-VolumesSnapshotTestJSON-instance-2116039095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2116039095',id=11,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3lTzizryWlzCdn9FSoOlR4KArK4o6ryEJKeCReMIGKjDUVRM8+fKOd6jvV5XFFWq8ze+S7iYMe3EDljzUk02hsPQg3XbHRV8mcJor9h93MDbJaY6uKUkG+IbJ8CJdmYg==',key_name='tempest-keypair-1112517365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-o5h7idug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=f3d16138-3e3e-4848-bfcd-d0273f300c86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG os_vif [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10882c8e-7e21-5588-a7a7-f27d99e3f608', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd37ff7cb-97, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd37ff7cb-97, col_values=(('qos', UUID('6cfd2c66-ff9f-4595-a10b-e64e7d0a8d17')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd37ff7cb-97, col_values=(('external_ids', {'iface-id': 'd37ff7cb-9750-44bc-976c-309de6f3d691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:18:1c', 'vm-uuid': 'f3d16138-3e3e-4848-bfcd-d0273f300c86'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:56 user nova-compute[75409]: INFO os_vif [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97')
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No VIF found with MAC fa:16:3e:87:18:1c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:25:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eae32b9e-43b2-47db-8832-7e12c6e2bf92 req-0d119170-5a8f-4208-a547-cca48ebfd303 service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:25:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-changed-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Refreshing instance network info cache due to event network-changed-d37ff7cb-9750-44bc-976c-309de6f3d691. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Acquiring lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Acquired lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Refreshing network info cache for port d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updated VIF entry in instance network info cache for port d37ff7cb-9750-44bc-976c-309de6f3d691. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updating instance_info_cache with network_info: [{"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Releasing lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-d7503dd6-ad9a-4dca-a387-2cefce9e784c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:25:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [{"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:25:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:25:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance network_info: |[{"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:25:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:25:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updated VIF entry in instance network info cache for port d7503dd6-ad9a-4dca-a387-2cefce9e784c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [{"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d78b1ff3-04cb-4e75-8335-eb7e905a22d7 req-cf5cd122-4d49-4850-870a-189fe9871b88 service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:26:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Instance spawned successfully.
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:00 user nova-compute[75409]: INFO nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Booting with volume c4a4df1f-6541-4425-af34-4477ec7338bf at /dev/vdc
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:00 user nova-compute[75409]: INFO nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aca920-8272-4ccf-99e9-f8d8b620e041]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc22c6f-4334-49ec-9993-a036c5c2ea1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a2c3e-9a70-4520-8f73-44f664728637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175e861-b374-4b32-b9db-8bf80030090f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:00 user nova-compute[75409]: INFO nova.compute.manager [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Took 7.33 seconds to build instance.
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:00 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98db47-2afa-4499-98f0-a2b54e9b40a2]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG os_brick.utils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating existing volume attachment record: 8891fcb4-1436-4d0b-8781-bde6d3d831e6 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-956ffd66-6c37-4299-bae8-0083e155ef04 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.430s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:26:01 user nova-compute[75409]: INFO nova.compute.claims [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Claim successful on node user
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:26:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.policy [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1a39965eca49a3968d2f663ee23456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db8991da84139a8cf85771d3ec173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:26:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Creating image(s)
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "/opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "/opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk 1073741824" returned: 0 in 0.061s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Successfully created port: 27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.220s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] No waiting events found dispatching network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:02 user nova-compute[75409]: WARNING nova.compute.manager [req-6fa84a4e-d37d-40f1-adeb-770d95e5856a req-f51a1c57-e204-41c3-b7bb-a33b78543282 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received unexpected event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 for instance with vm_state active and task_state None.
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Cannot resize image /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Successfully updated port: 27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquired lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-changed-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Refreshing instance network info cache due to event network-changed-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] Acquiring lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Updating instance_info_cache with network_info: [{"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Releasing lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Instance network_info: |[{"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] Acquired lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Refreshing network info cache for port 27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Start _get_guest_xml network_info=[{"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:26:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:26:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955419460',display_name='tempest-VolumesActionsTest-instance-955419460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955419460',id=12,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-94nm2yfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:26:02Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=c7f476c5-4d88-464e-adbb-78bad92b0aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f476c5-4d88-464e-adbb-78bad92b0aa9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:26:03 user nova-compute[75409]:   <uuid>c7f476c5-4d88-464e-adbb-78bad92b0aa9</uuid>
Nov 15 21:26:03 user nova-compute[75409]:   <name>instance-0000000c</name>
Nov 15 21:26:03 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:26:03 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:26:03 user nova-compute[75409]:   <metadata>
Nov 15 21:26:03 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:26:03 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:name>tempest-VolumesActionsTest-instance-955419460</nova:name>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:26:03</nova:creationTime>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:26:03 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:26:03 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:owner>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:user uuid="da1a39965eca49a3968d2f663ee23456">tempest-VolumesActionsTest-1907874876-project-member</nova:user>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:project uuid="4a7db8991da84139a8cf85771d3ec173">tempest-VolumesActionsTest-1907874876</nova:project>
Nov 15 21:26:03 user nova-compute[75409]:       </nova:owner>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:26:03 user nova-compute[75409]:       <nova:ports>
Nov 15 21:26:03 user nova-compute[75409]:         <nova:port uuid="27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380">
Nov 15 21:26:03 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:26:03 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:03 user nova-compute[75409]:       </nova:ports>
Nov 15 21:26:03 user nova-compute[75409]:     </nova:instance>
Nov 15 21:26:03 user nova-compute[75409]:   </metadata>
Nov 15 21:26:03 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:26:03 user nova-compute[75409]:     <system>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="serial">c7f476c5-4d88-464e-adbb-78bad92b0aa9</entry>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="uuid">c7f476c5-4d88-464e-adbb-78bad92b0aa9</entry>
Nov 15 21:26:03 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:26:03 user nova-compute[75409]:     </system>
Nov 15 21:26:03 user nova-compute[75409]:   </sysinfo>
Nov 15 21:26:03 user nova-compute[75409]:   <os>
Nov 15 21:26:03 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:26:03 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:26:03 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:26:03 user nova-compute[75409]:   </os>
Nov 15 21:26:03 user nova-compute[75409]:   <features>
Nov 15 21:26:03 user nova-compute[75409]:     <acpi/>
Nov 15 21:26:03 user nova-compute[75409]:     <apic/>
Nov 15 21:26:03 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:26:03 user nova-compute[75409]:   </features>
Nov 15 21:26:03 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:26:03 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:26:03 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:26:03 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:26:03 user nova-compute[75409]:   </clock>
Nov 15 21:26:03 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:26:03 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:26:03 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:26:03 user nova-compute[75409]:   </cpu>
Nov 15 21:26:03 user nova-compute[75409]:   <devices>
Nov 15 21:26:03 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:26:03 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:26:03 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk"/>
Nov 15 21:26:03 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:26:03 user nova-compute[75409]:     </disk>
Nov 15 21:26:03 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:03 user nova-compute[75409]:       <mac address="fa:16:3e:cf:b5:4e"/>
Nov 15 21:26:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:03 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:03 user nova-compute[75409]:       <target dev="tap27eaa11a-3b"/>
Nov 15 21:26:03 user nova-compute[75409]:     </interface>
Nov 15 21:26:03 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:26:03 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/console.log" append="off"/>
Nov 15 21:26:03 user nova-compute[75409]:     </serial>
Nov 15 21:26:03 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:26:03 user nova-compute[75409]:     <video>
Nov 15 21:26:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:03 user nova-compute[75409]:     </video>
Nov 15 21:26:03 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:26:03 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:26:03 user nova-compute[75409]:     </rng>
Nov 15 21:26:03 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:26:03 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:26:03 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:26:03 user nova-compute[75409]:     </memballoon>
Nov 15 21:26:03 user nova-compute[75409]:   </devices>
Nov 15 21:26:03 user nova-compute[75409]: </domain>
Nov 15 21:26:03 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:26:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955419460',display_name='tempest-VolumesActionsTest-instance-955419460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955419460',id=12,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-94nm2yfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:26:02Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=c7f476c5-4d88-464e-adbb-78bad92b0aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG os_vif [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cff9b0a3-fd9b-5c3f-a43e-f1bbf7e2fb19', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27eaa11a-3b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27eaa11a-3b, col_values=(('qos', UUID('2159c3cb-2570-4105-8c0b-cf02ffbaec61')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27eaa11a-3b, col_values=(('external_ids', {'iface-id': '27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:b5:4e', 'vm-uuid': 'c7f476c5-4d88-464e-adbb-78bad92b0aa9'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:03 user nova-compute[75409]: INFO os_vif [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b')
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] No VIF found with MAC fa:16:3e:cf:b5:4e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Updated VIF entry in instance network info cache for port 27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Updating instance_info_cache with network_info: [{"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dccfd14-c755-4758-a116-513f5004c681 req-f8fe1d86-c799-4497-8dfa-30d68d15bffc service nova] Releasing lock "refresh_cache-c7f476c5-4d88-464e-adbb-78bad92b0aa9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] No waiting events found dispatching network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:04 user nova-compute[75409]: WARNING nova.compute.manager [req-18bbc9d3-d4b5-4052-9721-47c44b944caf req-13caa3de-fce4-4982-9179-8300f46b6214 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received unexpected event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 for instance with vm_state active and task_state None.
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] No waiting events found dispatching network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:05 user nova-compute[75409]: WARNING nova.compute.manager [req-9b8aee48-dfad-4205-95d3-804e26a154da req-0ff30cab-ab0f-4610-8afb-f50aebebbe82 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received unexpected event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 for instance with vm_state building and task_state spawning.
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:26:06 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Creating image(s)
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Ensure instance console log exists: /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Start _get_guest_xml network_info=[{"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skTbUNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfd4714a-e37d-4984-a130-d20cb62578f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f83a21b7-9c42-49a9-b9a3-af51be173b09', 'serial': 'f83a21b7-9c42-49a9-b9a3-af51be173b09'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'ff13e4eb-3f91-4ed7-aaff-b597bdf66258', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoMCeQuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfd4714a-e37d-4984-a130-d20cb62578f3', 'attached_at': '', 'detached_at': '', 'volume_id': '1fb851e4-5923-4902-a52d-1ba92a864fe4', 'serial': '1fb851e4-5923-4902-a52d-1ba92a864fe4'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '1665b019-f479-4519-bb6c-813df5b495da', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDHjGFOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfd4714a-e37d-4984-a130-d20cb62578f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4a4df1f-6541-4425-af34-4477ec7338bf', 'serial': 'c4a4df1f-6541-4425-af34-4477ec7338bf'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '8891fcb4-1436-4d0b-8781-bde6d3d831e6', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:26:06 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:06 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connector [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Factory for ISCSI on None {{(pid=75409) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skTbUNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:06 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:06 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:06 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[920deac8-c79d-4b60-bd2d-97d21592b391]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:26:06 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a5c56-2d1e-47d3-9522-5ffa510e2fcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09] added
Nov 15 21:26:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f419584-3e27-490f-af1a-907c71e04790]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c7c2cc-ce90-455c-b392-4398fde4cbeb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skTbUNhn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skTbUNhn" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a1e87-5389-44c8-8b59-a37a263a6384]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skTbUNhn'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0f7ba-8d15-4104-ac7f-42b0b184c068]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c6c46-d3a5-4dc2-9740-375c5473aba7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:26:06 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:26:06 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:06 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:26:06 user nova-compute[75409]: 
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef955546-c779-4cb9-be6a-cd14f19fb4ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260]
Nov 15 21:26:06 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2586b16b-612d-41f1-8ae5-0ca90f727b8b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7755a9a-faae-4c6d-ac8c-13dde128ca29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f59f7d-a15f-46ff-89c8-548b4b811392]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:26:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skTbUNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:26:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Instance spawned successfully.
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:07 user nova-compute[75409]: INFO nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:07 user nova-compute[75409]: INFO nova.compute.manager [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Took 6.49 seconds to build instance.
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5e6e6d27-da83-4a6c-bcc5-41233aaf85d7 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.618s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] No waiting events found dispatching network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:07 user nova-compute[75409]: WARNING nova.compute.manager [req-9768edd7-3eca-42cd-9832-ef2633b1ee63 req-a24330ba-63dd-45f1-adc0-10dc686cb684 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received unexpected event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 for instance with vm_state building and task_state spawning.
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23961303361333837', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303361333837', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoMCeQuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:07 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:07 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:07 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f756e-ef19-458d-bbbc-d4485e089c34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:26:07 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb756f5-de7c-4bab-8bcb-af1e3b1ba3df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4] added
Nov 15 21:26:07 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae97af7-e9ce-451b-9696-e4a63f2829ad]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[868791b3-0782-41b1-99c1-1d36483de45b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoMCeQuB {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoMCeQuB" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b64e62-ee78-42a1-ba75-45707a271872]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YoMCeQuB'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce01607-a012-4e0e-abb6-3f19b1aba611]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[92591c19-2fa7-4909-b01c-0c4494c2aa6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4044ba-c99a-4e52-9a45-5a896ae60170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260]
Nov 15 21:26:08 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aefe04d-8740-4be9-b069-535342ebcd71]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[25937d54-0b3b-4140-b119-5022a37e14b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c42fd6-9859-42fa-a015-0deee9160661]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoMCeQuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23264613230373733', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264613230373733', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDHjGFOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:09 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f20eef1-4afa-4056-9c1d-a7567885779d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:26:09 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b286a27-b745-4638-9576-440838b230ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf] added
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d44ad-a791-4282-98c7-7fbe67de9bb4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac6eb7-03ff-47d5-aa69-4173f18e4f07]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDHjGFOC {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDHjGFOC" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6afb63-e466-4dd1-8364-eda45eb53c51]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDHjGFOC'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80f84ed-668e-47fe-aa8e-68c6bd1eceae]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922f4d5-52ca-4ec6-b349-9995b6904ac6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af41156f-61ca-4b06-965c-37082be1ab66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260]
Nov 15 21:26:09 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc7d4c7-1438-42d0-b37d-b8058b67c359]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[949de6a3-9f2b-42f7-b48a-72f125442044]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:09 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae823cd-f8c9-4df3-b170-57a9e715bf01]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:26:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDHjGFOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26364323134646330', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364323134646330', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.objects.instance [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lazy-loading 'pci_devices' on Instance uuid dfd4714a-e37d-4984-a130-d20cb62578f3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:26:10 user nova-compute[75409]:   <uuid>dfd4714a-e37d-4984-a130-d20cb62578f3</uuid>
Nov 15 21:26:10 user nova-compute[75409]:   <name>instance-0000000a</name>
Nov 15 21:26:10 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:26:10 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:26:10 user nova-compute[75409]:   <metadata>
Nov 15 21:26:10 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:26:10 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:name>tempest-device-tagging-server-664500406</nova:name>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:26:06</nova:creationTime>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:26:10 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:26:10 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:owner>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:user uuid="d095f7c953144aec82b4ea20dbbcdcc6">tempest-TaggedBootDevicesTest_v242-1511009455-project-member</nova:user>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:project uuid="69baabcae00c484aae8abcc1acbdaa0e">tempest-TaggedBootDevicesTest_v242-1511009455</nova:project>
Nov 15 21:26:10 user nova-compute[75409]:       </nova:owner>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:26:10 user nova-compute[75409]:       <nova:ports>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="be06eaae-06be-4a7b-8fa3-caa1dca1917c">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="2137497b-7fbd-4bbc-b864-00d1abae473e">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="7e99326a-2e70-4981-89c4-892e82abae98">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="dec4fb56-145e-43d2-9be4-c5d137983604">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="7c273184-82d1-4852-84bb-469230dc6348">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="7629e08f-74c1-41a2-907f-5d7b6b0b0baa">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:         <nova:port uuid="d7503dd6-ad9a-4dca-a387-2cefce9e784c">
Nov 15 21:26:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 21:26:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:26:10 user nova-compute[75409]:       </nova:ports>
Nov 15 21:26:10 user nova-compute[75409]:     </nova:instance>
Nov 15 21:26:10 user nova-compute[75409]:   </metadata>
Nov 15 21:26:10 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:26:10 user nova-compute[75409]:     <system>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="serial">dfd4714a-e37d-4984-a130-d20cb62578f3</entry>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="uuid">dfd4714a-e37d-4984-a130-d20cb62578f3</entry>
Nov 15 21:26:10 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:26:10 user nova-compute[75409]:     </system>
Nov 15 21:26:10 user nova-compute[75409]:   </sysinfo>
Nov 15 21:26:10 user nova-compute[75409]:   <os>
Nov 15 21:26:10 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:26:10 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:26:10 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:26:10 user nova-compute[75409]:   </os>
Nov 15 21:26:10 user nova-compute[75409]:   <features>
Nov 15 21:26:10 user nova-compute[75409]:     <acpi/>
Nov 15 21:26:10 user nova-compute[75409]:     <apic/>
Nov 15 21:26:10 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:26:10 user nova-compute[75409]:   </features>
Nov 15 21:26:10 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:26:10 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:26:10 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:26:10 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:26:10 user nova-compute[75409]:   </clock>
Nov 15 21:26:10 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:26:10 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:26:10 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:26:10 user nova-compute[75409]:   </cpu>
Nov 15 21:26:10 user nova-compute[75409]:   <devices>
Nov 15 21:26:10 user nova-compute[75409]:     <disk type="file" device="cdrom">
Nov 15 21:26:10 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 21:26:10 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/disk.config"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="hda" bus="ide"/>
Nov 15 21:26:10 user nova-compute[75409]:     </disk>
Nov 15 21:26:10 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:26:10 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:26:10 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <serial>f83a21b7-9c42-49a9-b9a3-af51be173b09</serial>
Nov 15 21:26:10 user nova-compute[75409]:     </disk>
Nov 15 21:26:10 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:26:10 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:26:10 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <serial>1fb851e4-5923-4902-a52d-1ba92a864fe4</serial>
Nov 15 21:26:10 user nova-compute[75409]:     </disk>
Nov 15 21:26:10 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:26:10 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:26:10 user nova-compute[75409]:       <source dev="/dev/sdd"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="vdc" bus="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <serial>c4a4df1f-6541-4425-af34-4477ec7338bf</serial>
Nov 15 21:26:10 user nova-compute[75409]:     </disk>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:76:64:be"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tapbe06eaae-06"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:9b:31:70"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tap2137497b-7f"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:68:f6:a1"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tap7e99326a-2e"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:5f:53:6f"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tapdec4fb56-14"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:3d:d2:89"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tap7c273184-82"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:5e:5c:3b"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tap7629e08f-74"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:26:10 user nova-compute[75409]:       <mac address="fa:16:3e:46:0a:0f"/>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:26:10 user nova-compute[75409]:       <target dev="tapd7503dd6-ad"/>
Nov 15 21:26:10 user nova-compute[75409]:     </interface>
Nov 15 21:26:10 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:26:10 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/console.log" append="off"/>
Nov 15 21:26:10 user nova-compute[75409]:     </serial>
Nov 15 21:26:10 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:26:10 user nova-compute[75409]:     <video>
Nov 15 21:26:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:26:10 user nova-compute[75409]:     </video>
Nov 15 21:26:10 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:26:10 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:26:10 user nova-compute[75409]:     </rng>
Nov 15 21:26:10 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:26:10 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:26:10 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:26:10 user nova-compute[75409]:     </memballoon>
Nov 15 21:26:10 user nova-compute[75409]:   </devices>
Nov 15 21:26:10 user nova-compute[75409]: </domain>
Nov 15 21:26:10 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8295b28-0a4e-595f-9b23-b074cbcb9418', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe06eaae-06, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe06eaae-06, col_values=(('qos', UUID('b569ec68-f94e-4ce0-a921-fddfa16df1f4')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe06eaae-06, col_values=(('external_ids', {'iface-id': 'be06eaae-06be-4a7b-8fa3-caa1dca1917c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:64:be', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06')
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df833edf-f53a-5c45-b69a-4171b84346cd', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2137497b-7f, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2137497b-7f, col_values=(('qos', UUID('996594bc-7387-4e1c-9d52-bcc8453b700d')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2137497b-7f, col_values=(('external_ids', {'iface-id': '2137497b-7fbd-4bbc-b864-00d1abae473e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:31:70', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f')
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f81324f-395b-50ce-a7f6-33a6c44b664c', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e99326a-2e, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e99326a-2e, col_values=(('qos', UUID('a70097e8-62c3-402f-82d7-ec408e5a3059')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e99326a-2e, col_values=(('external_ids', {'iface-id': '7e99326a-2e70-4981-89c4-892e82abae98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f6:a1', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e')
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf30b289-568c-5a4f-9d36-b38bd4d526ea', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec4fb56-14, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdec4fb56-14, col_values=(('qos', UUID('03065acf-5fb8-447a-8762-4971b6532819')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdec4fb56-14, col_values=(('external_ids', {'iface-id': 'dec4fb56-145e-43d2-9be4-c5d137983604', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:53:6f', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14')
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f3bf3f9-f39a-5ac8-ac0b-fec9eac3f9c3', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c273184-82, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c273184-82, col_values=(('qos', UUID('55324b86-5edc-4dee-86d1-0ec035ed85c0')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c273184-82, col_values=(('external_ids', {'iface-id': '7c273184-82d1-4852-84bb-469230dc6348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:d2:89', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82')
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '917fa49c-bd17-5030-a185-30de00ac7256', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7629e08f-74, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7629e08f-74, col_values=(('qos', UUID('56572da0-2509-4173-8764-32d6c0fe98a1')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7629e08f-74, col_values=(('external_ids', {'iface-id': '7629e08f-74c1-41a2-907f-5d7b6b0b0baa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:5c:3b', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74')
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:25:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6c348c7-686f-5d43-b6bd-f55826b5120e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7503dd6-ad, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7503dd6-ad, col_values=(('qos', UUID('c8723a7f-11d4-4632-b35f-309d3b697c6c')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7503dd6-ad, col_values=(('external_ids', {'iface-id': 'd7503dd6-ad9a-4dca-a387-2cefce9e784c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:0a:0f', 'vm-uuid': 'dfd4714a-e37d-4984-a130-d20cb62578f3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:11 user nova-compute[75409]: INFO os_vif [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad')
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] No BDM found with device name hda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] No VIF found with MAC fa:16:3e:76:64:be, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] No VIF found with MAC fa:16:3e:3d:d2:89, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Using config drive
Nov 15 21:26:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Creating config drive at /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/disk.config
Nov 15 21:26:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy6d6gwwc {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy6d6gwwc" returned: 0 in 0.057s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:13 user nova-compute[75409]: WARNING nova.compute.manager [req-de92a515-409d-4936-a160-8d6f10bca76f req-40e16460-792c-4c50-9ef4-0e40783de7c7 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c for instance with vm_state building and task_state spawning.
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:14 user nova-compute[75409]: WARNING nova.compute.manager [req-cb8356bf-b438-4347-842c-b571805c94cf req-a0b032ff-cab7-43c8-91f6-688de6a13799 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 for instance with vm_state building and task_state spawning.
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:14 user nova-compute[75409]: WARNING nova.compute.manager [req-4b229ce1-dbbc-4d14-ac4a-c096cccdb7ae req-6e5be18b-4288-4792-b858-f71565134451 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 for instance with vm_state building and task_state spawning.
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c869f6c4-007c-4886-8d9c-bf894111c05a req-1185ae03-324e-4d43-9ecf-6ccf3378302d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa for instance with vm_state building and task_state spawning.
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:16 user nova-compute[75409]: WARNING nova.compute.manager [req-b9e7a718-1034-45e3-8c7a-e5ec708f1274 req-3f6fdffa-4fe2-45c6-ad0b-f98ba899fdc9 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 for instance with vm_state building and task_state spawning.
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:16 user nova-compute[75409]: WARNING nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 for instance with vm_state building and task_state spawning.
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:16 user nova-compute[75409]: WARNING nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c for instance with vm_state building and task_state spawning.
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:16 user nova-compute[75409]: WARNING nova.compute.manager [req-395f556a-83f8-4e88-909f-a3a07ad8674a req-9ad9eae8-2867-4248-a266-8cb7d9c90b1c service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c for instance with vm_state building and task_state spawning.
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:26:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance spawned successfully.
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:26:17 user nova-compute[75409]: INFO nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Took 11.01 seconds to spawn the instance on the hypervisor.
Nov 15 21:26:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:17 user nova-compute[75409]: INFO nova.compute.manager [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Took 32.26 seconds to build instance.
Nov 15 21:26:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-daaf09b1-b0e6-4cc2-a912-9412a1aed97a tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.374s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG nova.objects.instance [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lazy-loading 'flavor' on Instance uuid ef0e75f6-944c-4960-8548-4de9db2e5655 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:24 user nova-compute[75409]: INFO nova.compute.manager [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Attaching volume b59ae349-1684-40c2-8cca-fd7048705f6f to /dev/vdb
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.utils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb71152f-1d85-4d71-9acb-17daa47da6ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f142e9ce-03aa-4b53-b680-d009dfae9296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8623be10-caa9-4e29-a107-2f888c1ed1b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d6eab-434c-4d54-8513-a5518fcabbf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:24 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:26:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7c5f8-3f9e-4518-b2f2-b3bd6f1e4c8c]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG os_brick.utils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:24 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updating existing volume attachment record: 4c7699f5-1cfc-4cd9-8eeb-b34870984751 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:26:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saeqpnvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:29 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:29 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:29 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc4f65-342d-4983-8a7e-24a6df400a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:26:29 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ab6637-7439-4d06-8328-152780bc1752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f] added
Nov 15 21:26:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a5895e-7196-4a61-9754-2946ef3fea13]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[881e37c1-f3f2-43ea-95bf-672ed9fa7e2e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saeqpnvf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saeqpnvf" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa8a12-b732-4763-87e1-52052ed69239]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saeqpnvf'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a243c0b-d22f-40e1-9312-916e77419bc4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d30a8-0920-4902-ad14-e0a8e25ffae4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[68772663-81ab-423c-a04f-5fab3f415452]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260]
Nov 15 21:26:30 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829642b-6b5e-4962-b90f-7555fb2f11a0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b5a7d-faf0-4164-8636-7161e79b0c49]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)
Nov 15 21:26:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:30 user nova-compute[75409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)
Nov 15 21:26:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0519308-c530-4bc3-930e-a2647cfeb0b8]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saeqpnvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing instance network info cache due to event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG nova.network.neutron [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG nova.network.neutron [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updated VIF entry in instance network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG nova.network.neutron [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-56cbca6f-8dec-4b53-bf95-a987b13a82c6 req-07f78bbb-de28-4110-957b-dd609ecf14cf service nova] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26565663434616564', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565663434616564', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lazy-loading 'flavor' on Instance uuid ef0e75f6-944c-4960-8548-4de9db2e5655 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:26:31 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:26:31 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:26:31 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:26:31 user nova-compute[75409]:   <serial>b59ae349-1684-40c2-8cca-fd7048705f6f</serial>
Nov 15 21:26:31 user nova-compute[75409]: </disk>
Nov 15 21:26:31 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] No VIF found with MAC fa:16:3e:01:51:21, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-75a17557-87df-4dfa-8d0a-c54fc046e0cf tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.466s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:32 user nova-compute[75409]: INFO nova.compute.manager [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Terminating instance
Nov 15 21:26:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-unplugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] No waiting events found dispatching network-vif-unplugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-1db2c464-4c11-4a28-a4b2-12b2ccb9de72 req-1cfb7c18-08fe-4265-856d-5c9d6fc881b5 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-unplugged-2a29befb-ea76-4786-b40c-373d69091e51 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:26:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Instance destroyed successfully.
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lazy-loading 'resources' on Instance uuid ef0e75f6-944c-4960-8548-4de9db2e5655 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1728322071',display_name='tempest-DeleteServersTestJSON-server-1728322071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1728322071',id=1,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:24:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bee71a3b7d76412ba5333fb7b342e70b',ramdisk_id='',reservation_id='r-szjcvkng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1966991890',owner_user_name='tempest-DeleteServersTestJSON-1966991890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:24:46Z,user_data=None,user_id='9cdc66ccd2954c3386ad848d7905af53',uuid=ef0e75f6-944c-4960-8548-4de9db2e5655,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converting VIF {"id": "2a29befb-ea76-4786-b40c-373d69091e51", "address": "fa:16:3e:01:51:21", "network": {"id": "c5da971b-2ba8-4b6c-80f6-e1ea69d0450a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646939761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bee71a3b7d76412ba5333fb7b342e70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a29befb-ea", "ovs_interfaceid": "2a29befb-ea76-4786-b40c-373d69091e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_vif [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a29befb-ea, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69c3d8a4-62c1-4b26-8268-c593d2dc44ea) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: INFO os_vif [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:51:21,bridge_name='br-int',has_traffic_filtering=True,id=2a29befb-ea76-4786-b40c-373d69091e51,network=Network(c5da971b-2ba8-4b6c-80f6-e1ea69d0450a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a29befb-ea')
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saeqpnvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:33 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ca0ee-bc3f-4e4d-affc-35e2c6f89fb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:26:33 user nova-compute[75409]: No targets found.
Nov 15 21:26:33 user nova-compute[75409]: iSNS:
Nov 15 21:26:33 user nova-compute[75409]: No targets found.
Nov 15 21:26:33 user nova-compute[75409]: STATIC:
Nov 15 21:26:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:26:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:26:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:26:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:26:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:26:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:26:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:26:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:26:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:26:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f
Nov 15 21:26:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:26:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:26:33 user nova-compute[75409]: FIRMWARE:
Nov 15 21:26:33 user nova-compute[75409]: No targets found.
Nov 15 21:26:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:26:33 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:26:33 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f163b-6049-4429-978f-d96224ae5a92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d55b5b7-11cc-4699-8061-bd1ee64f3e93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)
Nov 15 21:26:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:33 user nova-compute[75409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f (non-flash)
Nov 15 21:26:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28556050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dbee96-4c45-41b4-b15a-69ea5cea1a4a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.compute.manager [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Shelving
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64f7f7-120a-400f-87c5-e617174d32ee]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57692d-c270-421c-8a04-f20801d5368a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd62e0-4818-4d9a-b202-ad9fb95eefde]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f2544-9f32-48bc-b5f9-28489649d630]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5c8f8-ee0d-4c5d-8df8-0aa4ee7c4022]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260]
Nov 15 21:26:33 user nova-compute[75409]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ae349-1684-40c2-8cca-fd7048705f6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03f1f3-957c-4c75-82a4-31895fb01975]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] <== disconnect_volume: return (346ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Deleting instance files /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655_del
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Deletion of /opt/stack/data/nova/instances/ef0e75f6-944c-4960-8548-4de9db2e5655_del complete
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:33 user nova-compute[75409]: WARNING nova.compute.manager [req-c444af8a-2f4e-41af-ade5-7d455c77a421 req-74d61fee-5734-43b2-8036-aecd70d71319 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state active and task_state shelving.
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75409) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.virt.libvirt.host [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] UEFI support detected
Nov 15 21:26:33 user nova-compute[75409]: INFO nova.compute.manager [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 15 21:26:33 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:26:33 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:26:34 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance destroyed successfully.
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:26:34 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Beginning cold snapshot process
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk /opt/stack/data/nova/instances/snapshots/tmpwoy704ot/4f661cf288564595adbb699cec0a59f1 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] Acquiring lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] No waiting events found dispatching network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:34 user nova-compute[75409]: WARNING nova.compute.manager [req-b2b36acc-2cd2-4daf-ad75-e5e68f215d03 req-39164ae4-31f2-441c-8014-4cb1150c6b6d service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received unexpected event network-vif-plugged-2a29befb-ea76-4786-b40c-373d69091e51 for instance with vm_state active and task_state deleting.
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:34 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Took 1.34 seconds to deallocate network for instance.
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing instance network info cache due to event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk /opt/stack/data/nova/instances/snapshots/tmpwoy704ot/4f661cf288564595adbb699cec0a59f1" returned: 0 in 1.033s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Snapshot extracted, beginning image upload
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated VIF entry in instance network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d3c4baf-c1a5-4c38-b0ad-07baa830214d req-7021ed3e-cca3-4922-9f79-a3b9e0b24f93 service nova] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:35 user nova-compute[75409]: WARNING nova.compute.manager [req-d1945201-cfda-4851-87e3-dcef9f383af2 req-7f2da58f-14ce-4ce7-825e-2bc3c1928563 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 21:26:35 user nova-compute[75409]: INFO nova.compute.manager [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Took 0.88 seconds to detach 1 volumes for instance.
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.385s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:26:36 user nova-compute[75409]: INFO nova.compute.manager [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] instance snapshotting
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.824s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Beginning live snapshot process
Nov 15 21:26:36 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Deleted allocations for instance ef0e75f6-944c-4960-8548-4de9db2e5655
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fa6660ad-e81e-43fe-b138-4a7ee515ffcb tempest-DeleteServersTestJSON-1966991890 tempest-DeleteServersTestJSON-1966991890-project-member] Lock "ef0e75f6-944c-4960-8548-4de9db2e5655" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.687s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-d4c4c595-bbf6-4403-ab11-2369f012470d req-4051979b-a7ed-4d74-b6e5-8c24940ca243 service nova] [instance: ef0e75f6-944c-4960-8548-4de9db2e5655] Received event network-vif-deleted-2a29befb-ea76-4786-b40c-373d69091e51 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645.delta 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645.delta 1073741824" returned: 0 in 0.050s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Snapshot image upload complete
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:38 user nova-compute[75409]: INFO nova.compute.manager [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Shelve offloading
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance destroyed successfully.
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645.delta /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645.delta /opt/stack/data/nova/instances/snapshots/tmpv2_oosi4/656c2a7be5aa40c78b96185e2dcfa645" returned: 0 in 0.375s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Snapshot extracted, beginning image upload
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing instance network info cache due to event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.network.neutron [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance destroyed successfully.
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'resources' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvhddLOARROj0AE+nWXziseLRd++fgTkb1aARPcvoXOTf1W6vh8nbbCd7hGGt6F4fpgez+/iZ9ovxv2kLP5GxxnHe0IWvqGdnBCRQJB7B6nApL+59XsaiwyQgBrkG/yLQ==',key_name='tempest-keypair-289692261',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:26:38.257628',shelved_host='user',shelved_image_id='0bc8c3c4-0b8a-4d58-a899-ca83c86d171a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG os_vif [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd098b838-c6, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b52de2ad-3b80-4d3e-be29-7ffba4bafe02) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:39 user nova-compute[75409]: INFO os_vif [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6')
Nov 15 21:26:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Deleting instance files /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b_del
Nov 15 21:26:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Deletion of /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b_del complete
Nov 15 21:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:40 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Deleted allocations for instance 77ef017e-9905-491a-9def-b81e289ac07b
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'numa_topology' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=6977MB free_disk=25.34801483154297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.objects.base [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77ef017e-9905-491a-9def-b81e289ac07b> lazy-loaded attributes: resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.network.neutron [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updated VIF entry in instance network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.network.neutron [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd098b838-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-890d48dc-65e2-4ac1-88b0-8d4e8bc2d2e2 req-b314eaf7-9952-4097-9198-252049af9b6b service nova] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.320s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9b578e52-739e-4c92-83bd-6ef610c901d6 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.686s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 498533a9-85ff-4309-bd4c-c97fb406aad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance bac6908e-d641-439c-bb4c-8a86352bb9d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01938a2b-fd10-4e70-80a1-918fb2de1d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 0208271e-c742-4fb4-8ae8-1fe9907d677b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dfd4714a-e37d-4984-a130-d20cb62578f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3d16138-3e3e-4848-bfcd-d0273f300c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7f476c5-4d88-464e-adbb-78bad92b0aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:26:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:42 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Snapshot image upload complete
Nov 15 21:26:42 user nova-compute[75409]: INFO nova.compute.manager [None req-357a1af9-fd12-461e-a126-ac8f45a514c2 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Took 5.67 seconds to snapshot the instance on the hypervisor.
Nov 15 21:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:26:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-changed-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Refreshing instance network info cache due to event network-changed-112a5b2a-327a-43a2-848f-4c2962b305b4. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] Acquiring lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] Acquired lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Refreshing network info cache for port 112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lazy-loading 'flavor' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:51 user nova-compute[75409]: INFO nova.compute.manager [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attaching volume 77f0954b-0d41-4112-b199-1924c20b59de to /dev/vdb
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.utils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a9275e-a058-4411-8a95-f8610957e135]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd11d0e-a755-4e47-b505-0c2f4f578e36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1cca13-7fd1-40df-88ab-e9004e433f48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[37425606-1065-4b11-a074-f656f5f3882e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:51 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532a680-83ab-44f3-b647-efdb0c87b563]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG os_brick.utils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating existing volume attachment record: 8d0197a6-c341-43f8-87ba-da3adb166b5d {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updated VIF entry in instance network info cache for port 112a5b2a-327a-43a2-848f-4c2962b305b4. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating instance_info_cache with network_info: [{"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cae1feea-7b46-412f-afda-d7b223a0681f req-18a51d13-ead6-4b3f-91ab-479c52299857 service nova] Releasing lock "refresh_cache-498533a9-85ff-4309-bd4c-c97fb406aad0" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-changed-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing instance network info cache due to event network-changed-2c2af0a6-959e-49c1-9e44-5eebe90e5636. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing network info cache for port 2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updated VIF entry in instance network info cache for port 2c2af0a6-959e-49c1-9e44-5eebe90e5636. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0314a026-9768-4473-8c51-eea0569ed09d req-2f00a13b-ba99-42ba-b207-804de718be90 service nova] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'pci_requests' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Object Instance<43bc3403-fc31-4527-8d38-1138e3f7bf8c> lazy-loaded attributes: flavor,pci_requests {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.policy [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa0ba006f108414a9ffdf717199eb4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52c16742b045bbb5416024054f062c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:26:56 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a736e98-b67f-4112-b7f5-a9970af8537e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:26:56 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa66345-8752-4b1e-9cfe-29939d30bb6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de] added
Nov 15 21:26:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34eef1-e6cb-409c-8146-2677497a1dd5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0e6e8-55cb-4168-958e-df175fc3df69]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvqaobEl {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvqaobEl" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[63588ef6-0ad0-4ca9-acf0-42413e7fe2a2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvqaobEl'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec14624-7661-4e11-a16e-7ecd17438706]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c151aaa-5ed5-4c4f-8bac-96675d4dc7ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:56 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:56 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:56 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:56 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ddb966-1eb0-444e-b951-fd76bbcae5a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]
Nov 15 21:26:56 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.
Nov 15 21:26:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964271c-123f-4c8f-b2dc-b588c69180c4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93b7fd-8b30-4a3c-95bc-aaa7a7885e16]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:26:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:26:57 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:26:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bea69b2-e4de-4b18-99bc-f6adfa677623]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Successfully created port: 4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Successfully updated port: 4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-changed-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing instance network info cache due to event network-changed-4ae5441c-a7a1-4794-aadc-eda58c223eee. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:26:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23935663732316566', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935663732316566', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lazy-loading 'flavor' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:26:58 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:26:58 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:26:58 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:26:58 user nova-compute[75409]:   <serial>77f0954b-0d41-4112-b199-1924c20b59de</serial>
Nov 15 21:26:58 user nova-compute[75409]: </disk>
Nov 15 21:26:58 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Refreshing network info cache for port 4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG os_vif [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '813db52b-fd0c-594b-9ffb-9fe9b59900d9', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae5441c-a7, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ae5441c-a7, col_values=(('qos', UUID('e302abe3-8346-4b2d-97a9-983724c59b73')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ae5441c-a7, col_values=(('external_ids', {'iface-id': '4ae5441c-a7a1-4794-aadc-eda58c223eee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:3c:ae', 'vm-uuid': '43bc3403-fc31-4527-8d38-1138e3f7bf8c'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: INFO os_vif [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7')
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] attach device xml: <interface type="ethernet">
Nov 15 21:26:58 user nova-compute[75409]:   <mac address="fa:16:3e:fa:3c:ae"/>
Nov 15 21:26:58 user nova-compute[75409]:   <model type="virtio"/>
Nov 15 21:26:58 user nova-compute[75409]:   <mtu size="1442"/>
Nov 15 21:26:58 user nova-compute[75409]:   <target dev="tap4ae5441c-a7"/>
Nov 15 21:26:58 user nova-compute[75409]: </interface>
Nov 15 21:26:58 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] No VIF found with MAC fa:16:3e:0e:ab:2c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:26:58 user nova-compute[75409]: WARNING nova.compute.manager [req-f5466351-45ce-4fe5-af7b-449f070983ac req-ffb5f643-ac20-42e2-8f58-e4a865a216b2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee for instance with vm_state active and task_state None.
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updated VIF entry in instance network info cache for port 4ae5441c-a7a1-4794-aadc-eda58c223eee. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a0be1991-e9f7-4f47-bf82-77df265cfde4 req-0e988765-30e6-470e-85ae-f7505bb4e0e3 service nova] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2cb0b25b-939f-4db8-aee3-4abb6e355454 tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.975s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name hda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No VIF found with MAC fa:16:3e:a1:21:08, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:26:58 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:26:58</nova:creationTime>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:26:58 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:26:58 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:owner>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:26:58 user nova-compute[75409]:   </nova:owner>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:26:58 user nova-compute[75409]:   <nova:ports>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:26:58 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:26:58 user nova-compute[75409]:     </nova:port>
Nov 15 21:26:58 user nova-compute[75409]:     <nova:port uuid="4ae5441c-a7a1-4794-aadc-eda58c223eee">
Nov 15 21:26:58 user nova-compute[75409]:       <nova:ip type="fixed" address="10.10.10.201" ipVersion="4"/>
Nov 15 21:26:58 user nova-compute[75409]:     </nova:port>
Nov 15 21:26:58 user nova-compute[75409]:   </nova:ports>
Nov 15 21:26:58 user nova-compute[75409]: </nova:instance>
Nov 15 21:26:58 user nova-compute[75409]:  {{(pid=75409) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-615ef76f-5e43-462b-9de4-2720da9e9a49 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.511s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:26:59 user nova-compute[75409]: INFO nova.compute.manager [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Attaching volume e98ba46f-2138-44e8-95da-a0ffe14a355f to /dev/vdb
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1af562-49cb-4217-9c5e-23f94722b9f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ae2b5-43a8-44d6-aa25-8ad233c23ecc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b237b086-ba4f-4fd9-a4ed-61092f20765b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3ffe43-8af2-46b1-98da-948ae5619736]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6a554-bdbd-482a-b201-598a8011ea79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:59 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12816e9-92e2-4035-b766-2210678801df]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a0f37-5334-4f72-b48e-8d53d5a593e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd623bf-230d-4959-a0fe-ba28852299ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da524c-21ff-4aec-9faa-438bdab7e5e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:26:59 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:26:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b6d29c-7f89-49c0-920d-9120d8c4faac]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:26:59 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating existing volume attachment record: 6b1722eb-1e18-40a1-bd14-bfcece9ddb8c {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:00 user nova-compute[75409]: INFO nova.compute.manager [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Swapping volume 77f0954b-0d41-4112-b199-1924c20b59de for 0b614384-2066-4fa8-a57d-e7a38c651d40
Nov 15 21:27:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:00 user nova-compute[75409]: WARNING nova.compute.manager [req-8f310b2a-0cef-4403-88e4-ea1c83d4fee4 req-a27963ec-d2f3-4d62-b30d-35740145c77b service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee for instance with vm_state active and task_state None.
Nov 15 21:27:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-changed-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Refreshing instance network info cache due to event network-changed-d046b4ac-8f50-4795-b3b4-9336cfc74bf1. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] Acquiring lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] Acquired lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Refreshing network info cache for port d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lazy-loading 'flavor' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updated VIF entry in instance network info cache for port d046b4ac-8f50-4795-b3b4-9336cfc74bf1. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating instance_info_cache with network_info: [{"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-752d67aa-f037-45a1-a5ef-1ef2c13eaf0c req-214885d2-36bc-4e46-9d6c-091f7d5f8b27 service nova] Releasing lock "refresh_cache-6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:01 user nova-compute[75409]: INFO nova.compute.manager [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Attaching volume 20d61252-f96b-4cda-a3a6-c4b218589308 to /dev/vdb
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.utils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6129fc7-9afa-49a3-adc5-404041cea837]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d917172-746b-4ce2-b389-310c185a1195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e18c8ec-7fb1-4496-af0a-f9d93d461be1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93180a96-4c10-4195-a114-6b0642c313ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:01 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf55fb-c759-4f90-b46a-1fd1c0e105e1]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG os_brick.utils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:01 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating existing volume attachment record: 9885993b-e35e-410d-9d4b-04e06d450cdf {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40', 'serial': '0b614384-2066-4fa8-a57d-e7a38c651d40'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0954b-0d41-4112-b199-1924c20b59de', 'serial'} {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 21:27:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:04 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:04 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:04 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3dd7bf-6864-494c-bc20-cd868a99654c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:05 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff012b-c358-4845-9538-c4f1ee14745f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40] added
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9b200-c58b-415a-ba2c-713445ba35bd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9896cf0-0043-4258-bad1-f1c0137e8780]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v meTdORXa {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v meTdORXa" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f0131-17d6-46c8-bf95-2f245b9c2aac]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'meTdORXa'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.137s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b41d2f-ccdf-4276-b3bb-280e37dc7257]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4389ae05-cdfc-4b21-b284-515eae2df6cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6323c1e-e4b8-4f28-9b36-23a1435caf50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260]
Nov 15 21:27:05 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1cd97-2ad8-40cf-98bc-0f2a387dcbc0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe0168d-48ac-47a6-8f0c-97246f1fe8aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:05 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c8b794-bc07-4aaa-a124-2d262fd8c5f7]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23237626633616437', 'path': '/dev/sdf'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237626633616437', 'path': '/dev/sdf'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lazy-loading 'flavor' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:06 user nova-compute[75409]: INFO nova.compute.manager [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Attaching volume ae3ee946-f24e-4391-be38-b00fbdb77693 to /dev/vdb
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.utils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6752ad26-fc3f-48e3-be3f-29654b8caf0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b0f65f-7404-465d-861d-53cc1838da37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6475ed8-45fe-4a34-8a25-aa97981b5325]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e342ff3-01ea-4d8c-a2c6-962ce7ee8f24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:07 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:07 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ebbee6-f654-44e2-915d-55a32eaec51d]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG os_brick.utils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating existing volume attachment record: 57b5108f-bd21-4e73-b99f-8340a4364ade {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 71303168 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 356515840 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 503316480 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 667942912 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDLbjsgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:10 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bc329-230d-4666-8e85-b39568a6debc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:10 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcVBEbAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd69f2-528a-4c9d-b3d4-3844b4812560]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f] added
Nov 15 21:27:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 811597824 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c426cc-2a8c-4345-ac19-c004533a0d5e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7346e77-bb99-43d4-909f-d4910070bdd2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDLbjsgp {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDLbjsgp" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66ac9d-cd7a-491c-80c6-2ec323ba75be]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wDLbjsgp'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa262efb-4807-4976-bf0d-08afaed00bae]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40848172-61a1-4f5a-9676-8e7c186b8d7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ae524-80b1-4c92-a5f8-13c0c577bf48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260]
Nov 15 21:27:11 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f6ad9-db07-4503-b681-00e314430cf0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4123d10f-c261-4065-815e-b82729af0171]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:11 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1479f4-fb0b-41be-b926-3c6df4c5409c]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 900726784 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDLbjsgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23261626332313731', 'path': '/dev/sdg'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261626332313731', 'path': '/dev/sdg'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.361s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:12 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:12 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.objects.instance [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea0a83-1217-4e98-a4ac-d7ca20b607eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:12 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:12 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:12 user nova-compute[75409]:   <source dev="/dev/sdg"/>
Nov 15 21:27:12 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:12 user nova-compute[75409]:   <serial>e98ba46f-2138-44e8-95da-a0ffe14a355f</serial>
Nov 15 21:27:12 user nova-compute[75409]: </disk>
Nov 15 21:27:12 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4804a0bf-be4e-4c22-b951-e359c6262c7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308] added
Nov 15 21:27:12 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f65f5c-7bbf-4b2a-bd8a-8cce8e7dc52f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b8728e-5d39-4db7-ae65-dd1c14547abc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcVBEbAZ {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcVBEbAZ" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18068a37-d2d2-4ce5-9e44-cd6c638b6233]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcVBEbAZ'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f920e-eae0-44fe-9000-6af51eb4883b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ef2e1-722d-4dbe-9166-f13071ad0bb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:12 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:12 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:12 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:12 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No BDM found with device name hda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] No VIF found with MAC fa:16:3e:a1:21:08, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6ffe0cbc-7875-4cfb-9ed6-50eca14e434e tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.128s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --login" returned: 0 in 1.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7aa0a-8c82-4c73-b3d9-4430223a022f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260]
Nov 15 21:27:13 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac9c148-7eee-4bde-96a4-fd68951d5963]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b9adcd-f3f8-4a92-851a-6458fe94737c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:13 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.322s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ae0be0-5683-42c6-bf6b-2cd5ea2c3eb0]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:14 user nova-compute[75409]: INFO nova.compute.manager [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Detaching volume e98ba46f-2138-44e8-95da-a0ffe14a355f
Nov 15 21:27:14 user nova-compute[75409]: INFO nova.virt.block_device [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Attempting to driver detach volume e98ba46f-2138-44e8-95da-a0ffe14a355f from mountpoint /dev/vdb
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Attempting to detach device vdb from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:14 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:14 user nova-compute[75409]:   <source dev="/dev/sdg"/>
Nov 15 21:27:14 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:14 user nova-compute[75409]:   <serial>e98ba46f-2138-44e8-95da-a0ffe14a355f</serial>
Nov 15 21:27:14 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:27:14 user nova-compute[75409]: </disk>
Nov 15 21:27:14 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully detached device vdb from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the persistent domain config.
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:14 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:14 user nova-compute[75409]:   <source dev="/dev/sdg"/>
Nov 15 21:27:14 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:14 user nova-compute[75409]:   <serial>e98ba46f-2138-44e8-95da-a0ffe14a355f</serial>
Nov 15 21:27:14 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:27:14 user nova-compute[75409]: </disk>
Nov 15 21:27:14 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcVBEbAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.359s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] <== connect_volume: return (3719ms) {'type': 'block', 'scsi_wwn': '23164643062353565', 'path': '/dev/sdh'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164643062353565', 'path': '/dev/sdh'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.939s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lazy-loading 'flavor' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275ce8a-8795-4cb9-a56b-5520f87da752]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:14 user nova-compute[75409]: No targets found.
Nov 15 21:27:14 user nova-compute[75409]: iSNS:
Nov 15 21:27:14 user nova-compute[75409]: No targets found.
Nov 15 21:27:14 user nova-compute[75409]: STATIC:
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40
Nov 15 21:27:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:14 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:14 user nova-compute[75409]: No targets found.
Nov 15 21:27:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:14 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:14 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:14 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:14 user nova-compute[75409]:   <source dev="/dev/sdh"/>
Nov 15 21:27:14 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:14 user nova-compute[75409]:   <serial>20d61252-f96b-4cda-a3a6-c4b218589308</serial>
Nov 15 21:27:14 user nova-compute[75409]: </disk>
Nov 15 21:27:14 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ce130-044a-4369-bb9f-db143cd778da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[10469e96-ee3f-4b4f-b9a0-7585b71ec153]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:14 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf286d7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c36b3b5-bfd0-47c2-b824-d9c4ad6b69b1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f6547-2a5e-4bab-8b21-0e432d0136ff]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9ee01d-bb8a-489f-86ff-3b2d639d3855]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81bc376-274b-4fa1-ba23-58e88bccb4e3]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e43362-3715-4232-a2ef-be9e8e87b8af]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50bfbf6-9130-4f00-ab5b-4b29368f060e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]
Nov 15 21:27:14 user nova-compute[75409]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[889732cf-9e33-467b-bd4f-27a5ffec46cd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== disconnect_volume: return (2270ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.267s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:14 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:14 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d96441b-069e-4cda-a166-237ea88001f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:15 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eca54f-f913-409a-9e0f-339af8a5f621]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693] added
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40', 'serial'} {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: removing Cinder connection for volume 77f0954b-0d41-4112-b199-1924c20b59de {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e2d60-6b83-4aa2-b234-6d427788303b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b3c6d-6435-474b-be51-65d00fa14698]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLVtJImv {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLVtJImv" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c9349-0524-4d14-82ad-2721c667ea5f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WLVtJImv'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] No VIF found with MAC fa:16:3e:9e:80:66, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af95faa-c39a-4d2c-aed9-c1ac8d982715]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0275cd-e6a0-4b0c-b322-75e7fa0fc673]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f93d2-6e0f-41f3-b9a4-f9ade5bff2f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]
Nov 15 21:27:15 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f627917b-b206-4b89-b244-338de2691d53 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.852s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d85c16-d387-447c-b14e-825e49afc1ec]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f414bfd3-5aaf-4ab0-89e8-e685e65564aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:15 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ffdeb-f33b-42ff-b492-0cbf882a31b4]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] volume_snapshot_create: create_info: {'snapshot_id': '12291559-5f83-4218-9665-f755b672b4b4', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75409) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] snap xml: <domainsnapshot>
Nov 15 21:27:15 user nova-compute[75409]:   <disks>
Nov 15 21:27:15 user nova-compute[75409]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 15 21:27:15 user nova-compute[75409]:       <source file="/dev/new_file"/>
Nov 15 21:27:15 user nova-compute[75409]:     </disk>
Nov 15 21:27:15 user nova-compute[75409]:     <disk name="vda" snapshot="no"/>
Nov 15 21:27:15 user nova-compute[75409]:   </disks>
Nov 15 21:27:15 user nova-compute[75409]: </domainsnapshot>
Nov 15 21:27:15 user nova-compute[75409]:  {{(pid=75409) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] Lazy-loading 'system_metadata' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 21:27:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-512c36fa-33be-4220-a652-4fd8f9a7876f tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] volume_snapshot_delete: delete_info: {'volume_id': '20d61252-f96b-4cda-a3a6-c4b218589308'} {{(pid=75409) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [None req-512c36fa-33be-4220-a652-4fd8f9a7876f tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     if delete_info['type'] != 'qcow2':
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] KeyError: 'type'
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     rv = execute(f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     six.reraise(c, e, tb)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     raise value
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     rv = meth(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     self._volume_snapshot_create(context, instance, guest,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     rv = execute(f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     six.reraise(c, e, tb)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     raise value
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     rv = meth(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [None req-512c36fa-33be-4220-a652-4fd8f9a7876f tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0e92b03e-c7d1-4b71-851d-4090ea91d005)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server [None req-512c36fa-33be-4220-a652-4fd8f9a7876f tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] Exception during message handling: KeyError: 'type'
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 12291559-5f83-4218-9665-f755b672b4b4 could not be found.
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 12291559-5f83-4218-9665-f755b672b4b4 could not be found. (HTTP 404) (Request-ID: req-c3c2b20d-91bb-4d5d-8d18-8e2742aa4a98)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 12291559-5f83-4218-9665-f755b672b4b4 could not be found.
Nov 15 21:27:15 user nova-compute[75409]: ERROR nova.virt.libvirt.driver 
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server [None req-c36a5b22-fd30-4efa-b808-b345f9f1d163 tempest-VolumesAssistedSnapshotsTest-931356853 tempest-VolumesAssistedSnapshotsTest-931356853-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 21:27:15 user nova-compute[75409]: ERROR oslo_messaging.rpc.server 
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: Updating volume 77f0954b-0d41-4112-b199-1924c20b59de BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "meTdORXa", "auth_password": "QJo7veI432Ea5G", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "0b614384-2066-4fa8-a57d-e7a38c651d40"}, "status": "reserved", "instance": "498533a9-85ff-4309-bd4c-c97fb406aad0", "attached_at": "", "detached_at": "", "volume_id": "0b614384-2066-4fa8-a57d-e7a38c651d40", "serial": "0b614384-2066-4fa8-a57d-e7a38c651d40"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40', 'no_device': None, 'attachment_id': '8c8885fd-a7d5-4749-83fe-b4509f875a84'} {{(pid=75409) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1911b81a-462b-4507-b275-bf1ce2514349 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.306s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:16 user nova-compute[75409]: INFO nova.compute.manager [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Detaching volume 20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:16 user nova-compute[75409]: INFO nova.virt.block_device [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Attempting to driver detach volume 20d61252-f96b-4cda-a3a6-c4b218589308 from mountpoint /dev/vdb
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Attempting to detach device vdb from instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:16 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:16 user nova-compute[75409]:   <source dev="/dev/sdh"/>
Nov 15 21:27:16 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:16 user nova-compute[75409]:   <serial>20d61252-f96b-4cda-a3a6-c4b218589308</serial>
Nov 15 21:27:16 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:27:16 user nova-compute[75409]: </disk>
Nov 15 21:27:16 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:16 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Successfully detached device vdb from instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 from the persistent domain config.
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:16 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:16 user nova-compute[75409]:   <source dev="/dev/sdh"/>
Nov 15 21:27:16 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:16 user nova-compute[75409]:   <serial>20d61252-f96b-4cda-a3a6-c4b218589308</serial>
Nov 15 21:27:16 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:27:16 user nova-compute[75409]: </disk>
Nov 15 21:27:16 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== connect_volume: return (2618ms) {'type': 'block', 'scsi_wwn': '26462626236613134', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462626236613134', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:16 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:16 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:27:16 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:16 user nova-compute[75409]:   <serial>ae3ee946-f24e-4391-be38-b00fbdb77693</serial>
Nov 15 21:27:16 user nova-compute[75409]: </disk>
Nov 15 21:27:16 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.utils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d810e-353c-4ca9-bc79-1103e6d6a353]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdff379-7a1a-46ec-a6eb-5692731d7cbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e68cd-cc94-46b0-9eb6-522573ef8915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb577b-2f44-40ff-8e76-7ec4ca186310]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:16 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d93bd-9319-4cef-b7de-8d1400b34ff3]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:16 user nova-compute[75409]: DEBUG os_brick.utils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:17 user nova-compute[75409]: INFO nova.compute.manager [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Swapping volume 0b614384-2066-4fa8-a57d-e7a38c651d40 for 77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No VIF found with MAC fa:16:3e:b8:6a:ed, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:17 user nova-compute[75409]: INFO nova.compute.manager [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Terminating instance
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ed30d969-7f6b-406b-816a-41b5de9737d8 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.233s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-unplugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] No waiting events found dispatching network-vif-unplugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-4376ff69-6868-4b21-9644-987525ad6751 req-795a5873-0cd7-4129-b8cc-d8772910777a service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-unplugged-358fee58-f98d-4510-8602-f6f1545c1625 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Instance destroyed successfully.
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lazy-loading 'resources' on Instance uuid 01938a2b-fd10-4e70-80a1-918fb2de1d58 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406813183',display_name='tempest-VolumesActionsTest-instance-1406813183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406813183',id=8,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de94f4eaef4d4c7db28a68c8c55db25d',ramdisk_id='',reservation_id='r-rv706gd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1432516137',owner_user_name='tempest-VolumesActionsTest-1432516137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:29Z,user_data=None,user_id='6479c6d2dc1f44889c7a1e82127f2861',uuid=01938a2b-fd10-4e70-80a1-918fb2de1d58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converting VIF {"id": "358fee58-f98d-4510-8602-f6f1545c1625", "address": "fa:16:3e:03:29:2e", "network": {"id": "140e762a-63f7-4ae1-8875-5d2d4aeeed37", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1281909690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de94f4eaef4d4c7db28a68c8c55db25d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap358fee58-f9", "ovs_interfaceid": "358fee58-f98d-4510-8602-f6f1545c1625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG os_vif [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap358fee58-f9, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36309ab1-e87f-4f03-9340-dd702a25d99e) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:17 user nova-compute[75409]: INFO os_vif [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:29:2e,bridge_name='br-int',has_traffic_filtering=True,id=358fee58-f98d-4510-8602-f6f1545c1625,network=Network(140e762a-63f7-4ae1-8875-5d2d4aeeed37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap358fee58-f9')
Nov 15 21:27:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Deleting instance files /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58_del
Nov 15 21:27:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Deletion of /opt/stack/data/nova/instances/01938a2b-fd10-4e70-80a1-918fb2de1d58_del complete
Nov 15 21:27:18 user nova-compute[75409]: INFO nova.compute.manager [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 21:27:18 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:18 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Took 0.44 seconds to deallocate network for instance.
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-29808c3f-b262-455a-81bd-4099fda63f45 req-38455e37-3282-4e61-8b0a-9dd451acf7b8 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-deleted-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:18 user nova-compute[75409]: INFO nova.compute.manager [req-29808c3f-b262-455a-81bd-4099fda63f45 req-38455e37-3282-4e61-8b0a-9dd451acf7b8 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Neutron deleted interface 358fee58-f98d-4510-8602-f6f1545c1625; detaching it from the instance and deleting it from the info cache
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-29808c3f-b262-455a-81bd-4099fda63f45 req-38455e37-3282-4e61-8b0a-9dd451acf7b8 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-29808c3f-b262-455a-81bd-4099fda63f45 req-38455e37-3282-4e61-8b0a-9dd451acf7b8 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Detach interface failed, port_id=358fee58-f98d-4510-8602-f6f1545c1625, reason: Instance 01938a2b-fd10-4e70-80a1-918fb2de1d58 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:27:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:18 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Deleted allocations for instance 01938a2b-fd10-4e70-80a1-918fb2de1d58
Nov 15 21:27:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5194cffe-c8c4-4fb7-8e86-5fabeb139f7d tempest-VolumesActionsTest-1432516137 tempest-VolumesActionsTest-1432516137-project-member] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] Acquiring lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] Lock "01938a2b-fd10-4e70-80a1-918fb2de1d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] No waiting events found dispatching network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:19 user nova-compute[75409]: WARNING nova.compute.manager [req-f976f94f-cb4d-463d-98df-1a7c2e4b63e9 req-19678807-f6a6-43e6-b0e8-d4fa7b752e25 service nova] [instance: 01938a2b-fd10-4e70-80a1-918fb2de1d58] Received unexpected event network-vif-plugged-358fee58-f98d-4510-8602-f6f1545c1625 for instance with vm_state deleted and task_state None.
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing instance network info cache due to event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated VIF entry in instance network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0954b-0d41-4112-b199-1924c20b59de', 'serial': '77f0954b-0d41-4112-b199-1924c20b59de'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40'}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40', 'serial'} {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:22 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:22 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:22 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06eed1ec-dd50-4309-ac78-780cba683cd8 req-a97f261c-8397-4755-aaf3-0acca045fec0 service nova] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[db57edaa-ef10-467f-91d6-05c4b43d79b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:22 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe082c-d3f0-449b-9a39-efccdad616b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de] added
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8caca-6430-4767-a14b-1ada49057b12]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1f2a5-989e-4c49-8823-76361b731cfa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvqaobEl {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvqaobEl" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4679dc-0cda-4148-b500-a4f66ba83b26]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvqaobEl'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[142872de-80c5-4e30-bb27-687150960430]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63b9fc-cbee-43e2-8480-1fab5666e12b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9befea-76cc-44d6-a066-3e349bcac15e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]
Nov 15 21:27:22 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590f0f2-b55a-4e45-b792-0c1a7bcef1fa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591b7da-85c6-404a-947e-ef2cb10561e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:22 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93856c27-bca9-4718-a4f5-45f7001bf85b]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23935663732316566', 'path': '/dev/sdi'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935663732316566', 'path': '/dev/sdi'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lazy-loading 'flavor' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing instance network info cache due to event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG nova.network.neutron [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 148897792 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:25 user nova-compute[75409]: DEBUG nova.network.neutron [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated VIF entry in instance network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:25 user nova-compute[75409]: DEBUG nova.network.neutron [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc3a6d58-58b5-452e-9f0a-c4b1faceee83 req-55d10c99-45e0-4ab1-bdeb-4fa4c4ca1d76 service nova] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 408944640 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 528482304 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 800063488 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 935329792 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:28 user nova-compute[75409]: INFO nova.compute.manager [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Rebooting instance
Nov 15 21:27:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:27:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'meTdORXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '0b614384-2066-4fa8-a57d-e7a38c651d40'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:29 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59704c2-fa43-4d79-950e-a7092d1533a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]: iSNS:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]: STATIC:
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:29 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:29 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[599f843f-9b3a-4711-82b9-e79f5d3ab076]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1be24f-f580-4abe-811a-0bce46e94300]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281bb6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40'): ({'sdf'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Removing single pathed devices sdf {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[688aa04e-95f7-4ce5-a2f7-6b471d881034]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be18529-6efa-4fa9-a650-3b74ced2fdc4]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Flushing IO for device /dev/sdf {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4edd7f-f3d2-4473-9a74-f22cad204427]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f222e1a-7f7f-4a0e-a791-5f25abc9f354]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:29 user nova-compute[75409]: WARNING nova.compute.manager [req-8d39cdb2-de3d-4449-afc3-58d848cab4ab req-ae29a879-05d2-418d-98e0-5638b3840d22 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[398cb69e-139b-415b-8198-1e9c4adde79a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9eab0f-5099-48e3-8aac-19cb29c9966a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260]
Nov 15 21:27:29 user nova-compute[75409]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b614384-2066-4fa8-a57d-e7a38c651d40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8889f6-4490-4642-899e-cd17df88bcf8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] <== disconnect_volume: return (365ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '498533a9-85ff-4309-bd4c-c97fb406aad0', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0954b-0d41-4112-b199-1924c20b59de', 'serial'} {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: removing Cinder connection for volume 0b614384-2066-4fa8-a57d-e7a38c651d40 {{(pid=75409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance destroyed successfully.
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'resources' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:27:29Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6464f2cb-6c, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=879b4f45-51cb-414c-8486-fbf6843d6c3f) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:29 user nova-compute[75409]: INFO os_vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c')
Nov 15 21:27:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:29 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[166576a7-839b-4e4c-b8af-757c8c2fe0d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]: iSNS:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]: STATIC:
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:29 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:29 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:29 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:29 user nova-compute[75409]: No targets found.
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:29 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:29 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca12bf-da2e-4236-8e5b-63f714bb96bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b22c1-d0bf-4955-be9e-cbdb5184bfc3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:29 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:29 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281c6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c1b906-d1e1-4e50-a731-727af8f29a57]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b19a4-1468-4b14-86d0-ca771c7b494a]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e268ef-67f5-47c4-8d44-e7a7dec5f64f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3293ee-d6de-40dd-8437-73d7f89e5bfe]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55f688-6faa-4ad5-b098-f177b04aeba1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32546bf8-1f1f-4871-8cb8-79b569d25179]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]
Nov 15 21:27:30 user nova-compute[75409]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b3275-1398-49c1-9444-a913e3df9cb9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== disconnect_volume: return (377ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start _get_guest_xml network_info=[{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eebd53c3-6230-49d5-8153-61b25b39b74f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'eebd53c3-6230-49d5-8153-61b25b39b74f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bac6908e-d641-439c-bb4c-8a86352bb9d9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae3ee946-f24e-4391-be38-b00fbdb77693', 'serial': 'ae3ee946-f24e-4391-be38-b00fbdb77693'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '57b5108f-bd21-4e73-b99f-8340a4364ade', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:27:30 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:27:30 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eebd53c3-6230-49d5-8153-61b25b39b74f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'vcpu_model' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.objects.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Object Instance<bac6908e-d641-439c-bb4c-8a86352bb9d9> lazy-loaded attributes: resources,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:30 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:30 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:30 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadf9f4-7cc5-4480-a133-ef3f98dcfd51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:30 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f184685-c101-44d8-9561-0522bffda9f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693] added
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47d25d-42a0-45a2-869e-26fc54b71b9c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-changed-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Refreshing instance network info cache due to event network-changed-71ccc38c-121a-45e1-85b0-694af41fac89. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] Acquiring lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] Acquired lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.network.neutron [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Refreshing network info cache for port 71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e238f3-5757-4caa-b8e0-86c967954e91]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLVtJImv {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLVtJImv" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d98582-9fc2-4521-8f60-417017ca421f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] swap_volume: Updating volume 0b614384-2066-4fa8-a57d-e7a38c651d40 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "cvqaobEl", "auth_password": "nzE1kwQCeWY7j9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "77f0954b-0d41-4112-b199-1924c20b59de"}, "status": "reserved", "instance": "498533a9-85ff-4309-bd4c-c97fb406aad0", "attached_at": "", "detached_at": "", "volume_id": "77f0954b-0d41-4112-b199-1924c20b59de", "serial": "77f0954b-0d41-4112-b199-1924c20b59de"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '77f0954b-0d41-4112-b199-1924c20b59de', 'no_device': None, 'attachment_id': '7c233920-304f-45ac-9200-dd0731302da4'} {{(pid=75409) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WLVtJImv'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-80f4dce5-be72-413f-96aa-a2b9756a6bb5 tempest-TestVolumeSwap-1684256182 tempest-TestVolumeSwap-1684256182-project-admin] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.771s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d8387-e3ca-4ac8-9738-97eec9706b2b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[01227dce-0bd6-4dc3-962f-36a15a711da3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1282a-8099-424e-ab25-7866f3be8515]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]
Nov 15 21:27:30 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f3b11-bf0d-40b5-82e0-c47e994bd856]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[98edb69d-f96e-4da9-a62d-ebe91fa79570]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:30 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7970fd7e-a95f-45c4-ba06-c214fc6d4997]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updated VIF entry in instance network info cache for port 71ccc38c-121a-45e1-85b0-694af41fac89. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating instance_info_cache with network_info: [{"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b15d12b-2c73-40bb-9f26-cfd09fe4f394 req-9fd3a097-d2a5-466f-bd55-9746a7482f2f service nova] Releasing lock "refresh_cache-0208271e-c742-4fb4-8ae8-1fe9907d677b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:31 user nova-compute[75409]: WARNING nova.compute.manager [req-ed68c117-859a-4227-a4b6-4e8fc7e2ccc8 req-9639f746-1af0-4c05-a267-1e9e7c741517 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:31 user nova-compute[75409]: INFO nova.compute.manager [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attaching volume 69edd15b-f331-479a-81cc-c00fadaac969 to /dev/vdb
Nov 15 21:27:31 user nova-compute[75409]: INFO nova.compute.manager [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Detaching volume 77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.utils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:31 user nova-compute[75409]: INFO nova.virt.block_device [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Attempting to driver detach volume 77f0954b-0d41-4112-b199-1924c20b59de from mountpoint /dev/vdb
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe45a88-332f-4ec0-ac43-d637a556c563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Attempting to detach device vdb from instance 498533a9-85ff-4309-bd4c-c97fb406aad0 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:31 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:31 user nova-compute[75409]:   <source dev="/dev/sdi"/>
Nov 15 21:27:31 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:   <serial>77f0954b-0d41-4112-b199-1924c20b59de</serial>
Nov 15 21:27:31 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:27:31 user nova-compute[75409]: </disk>
Nov 15 21:27:31 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:31 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Successfully detached device vdb from instance 498533a9-85ff-4309-bd4c-c97fb406aad0 from the persistent domain config.
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 498533a9-85ff-4309-bd4c-c97fb406aad0 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:31 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:31 user nova-compute[75409]:   <source dev="/dev/sdi"/>
Nov 15 21:27:31 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:   <serial>77f0954b-0d41-4112-b199-1924c20b59de</serial>
Nov 15 21:27:31 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:27:31 user nova-compute[75409]: </disk>
Nov 15 21:27:31 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf7968-050f-41fc-aeed-b369dc455889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368f683-c46a-4094-8c3b-0e920334db8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dc8ee0-9275-414d-8dc3-736bd5207a38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:31 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7c3c1-afd9-47a7-af4f-6cee2e0c8745]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.utils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating existing volume attachment record: 2e75e2b5-d67a-4c30-a3c2-cd140857b126 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26462626236613134', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462626236613134', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:27:29Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'pci_devices' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.objects.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Object Instance<bac6908e-d641-439c-bb4c-8a86352bb9d9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:27:31 user nova-compute[75409]:   <uuid>bac6908e-d641-439c-bb4c-8a86352bb9d9</uuid>
Nov 15 21:27:31 user nova-compute[75409]:   <name>instance-00000007</name>
Nov 15 21:27:31 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:27:31 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:27:31 user nova-compute[75409]:   <metadata>
Nov 15 21:27:31 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:31 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:name>tempest-TestMinimumBasicScenario-server-1600133315</nova:name>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:27:30</nova:creationTime>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:27:31 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:31 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:owner>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:user uuid="2612ed7971eb4b28966e02093c1eceeb">tempest-TestMinimumBasicScenario-998083421-project-member</nova:user>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:project uuid="e7535d0ebae4485c9252ad6909720f5f">tempest-TestMinimumBasicScenario-998083421</nova:project>
Nov 15 21:27:31 user nova-compute[75409]:       </nova:owner>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:root type="image" uuid="eebd53c3-6230-49d5-8153-61b25b39b74f"/>
Nov 15 21:27:31 user nova-compute[75409]:       <nova:ports>
Nov 15 21:27:31 user nova-compute[75409]:         <nova:port uuid="6464f2cb-6c06-4c15-ab77-8887d3e29593">
Nov 15 21:27:31 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:27:31 user nova-compute[75409]:         </nova:port>
Nov 15 21:27:31 user nova-compute[75409]:       </nova:ports>
Nov 15 21:27:31 user nova-compute[75409]:     </nova:instance>
Nov 15 21:27:31 user nova-compute[75409]:   </metadata>
Nov 15 21:27:31 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:27:31 user nova-compute[75409]:     <system>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="serial">bac6908e-d641-439c-bb4c-8a86352bb9d9</entry>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="uuid">bac6908e-d641-439c-bb4c-8a86352bb9d9</entry>
Nov 15 21:27:31 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:27:31 user nova-compute[75409]:     </system>
Nov 15 21:27:31 user nova-compute[75409]:   </sysinfo>
Nov 15 21:27:31 user nova-compute[75409]:   <os>
Nov 15 21:27:31 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:27:31 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:27:31 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:27:31 user nova-compute[75409]:   </os>
Nov 15 21:27:31 user nova-compute[75409]:   <features>
Nov 15 21:27:31 user nova-compute[75409]:     <acpi/>
Nov 15 21:27:31 user nova-compute[75409]:     <apic/>
Nov 15 21:27:31 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:27:31 user nova-compute[75409]:   </features>
Nov 15 21:27:31 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:27:31 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:27:31 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:27:31 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:27:31 user nova-compute[75409]:   </clock>
Nov 15 21:27:31 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:27:31 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:27:31 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:27:31 user nova-compute[75409]:   </cpu>
Nov 15 21:27:31 user nova-compute[75409]:   <devices>
Nov 15 21:27:31 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:27:31 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:27:31 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk"/>
Nov 15 21:27:31 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:     </disk>
Nov 15 21:27:31 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:27:31 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:31 user nova-compute[75409]:       <source dev="/dev/sde"/>
Nov 15 21:27:31 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:       <serial>ae3ee946-f24e-4391-be38-b00fbdb77693</serial>
Nov 15 21:27:31 user nova-compute[75409]:     </disk>
Nov 15 21:27:31 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:27:31 user nova-compute[75409]:       <mac address="fa:16:3e:b8:6a:ed"/>
Nov 15 21:27:31 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:27:31 user nova-compute[75409]:       <target dev="tap6464f2cb-6c"/>
Nov 15 21:27:31 user nova-compute[75409]:     </interface>
Nov 15 21:27:31 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:27:31 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/console.log" append="off"/>
Nov 15 21:27:31 user nova-compute[75409]:     </serial>
Nov 15 21:27:31 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:27:31 user nova-compute[75409]:     <video>
Nov 15 21:27:31 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:27:31 user nova-compute[75409]:     </video>
Nov 15 21:27:31 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:27:31 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:27:31 user nova-compute[75409]:     </rng>
Nov 15 21:27:31 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:27:31 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:27:31 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:27:31 user nova-compute[75409]:     </memballoon>
Nov 15 21:27:31 user nova-compute[75409]:   </devices>
Nov 15 21:27:31 user nova-compute[75409]: </domain>
Nov 15 21:27:31 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:27:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'trusted_certs' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.objects.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Object Instance<bac6908e-d641-439c-bb4c-8a86352bb9d9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Cannot resize image /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'migration_context' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.objects.base [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Object Instance<bac6908e-d641-439c-bb4c-8a86352bb9d9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:27:29Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG os_vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b87fbff8-e163-5073-831b-0632709d9130', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6464f2cb-6c, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6464f2cb-6c, col_values=(('qos', UUID('2dd83800-aa1b-4902-9b68-af2c4f373863')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6464f2cb-6c, col_values=(('external_ids', {'iface-id': '6464f2cb-6c06-4c15-ab77-8887d3e29593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:6a:ed', 'vm-uuid': 'bac6908e-d641-439c-bb4c-8a86352bb9d9'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:32 user nova-compute[75409]: INFO os_vif [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c')
Nov 15 21:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:34 user nova-compute[75409]: WARNING nova.compute.manager [req-99f2ab42-3415-4a92-9900-4188d868cf97 req-4016e661-ea8a-469d-adb6-34849032f82e service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 21:27:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c is timed out.
Nov 15 21:27:34 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully detached device vdb from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the live domain config.
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDLbjsgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:34 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[205204dd-377a-4b51-9eab-cabb57312dfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:34 user nova-compute[75409]: No targets found.
Nov 15 21:27:34 user nova-compute[75409]: iSNS:
Nov 15 21:27:34 user nova-compute[75409]: No targets found.
Nov 15 21:27:34 user nova-compute[75409]: STATIC:
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:34 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:34 user nova-compute[75409]: No targets found.
Nov 15 21:27:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:34 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:34 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96786666-fbae-4fa1-9e65-5d26e4a56ecb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f864e6-2e46-42e6-84f9-de1a9bee090d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f (non-flash)
Nov 15 21:27:34 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f'): ({'sdg'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Removing single pathed devices sdg {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a72aa-9863-41ef-b21a-e7ccb3944655]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83c060-1458-4834-a789-bd4d137c36ac]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Flushing IO for device /dev/sdg {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[879ca3be-2a67-4e3b-a36f-2df77a23ad20]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c3668-d9b5-4243-957a-47157dab4a6d]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] SCSI volumes sdg have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b06820-8e86-4dcb-8f2a-9e689637fe4f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5106165-e561-495b-b3d7-104db2f5e3ae]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260]
Nov 15 21:27:34 user nova-compute[75409]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e98ba46f-2138-44e8-95da-a0ffe14a355f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd4eaa-9df8-4320-9997-22bca4bfd33b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] <== disconnect_volume: return (351ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0c5a9b03-39b5-48d2-8c07-ef394abd09bd tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.893s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:36 user nova-compute[75409]: WARNING nova.compute.manager [req-68644568-5f34-47bb-8e7c-c2c0e90afee7 req-03a409c7-0dbd-42ae-b896-d3b0389a4b13 service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state active and task_state reboot_started_hard.
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:27:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance rebooted successfully.
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8622aa50-c9e6-49c8-a7d9-aba59ad97133 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.206s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-changed-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing instance network info cache due to event network-changed-be06eaae-06be-4a7b-8fa3-caa1dca1917c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] Acquiring lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] Acquired lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Refreshing network info cache for port be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 is timed out.
Nov 15 21:27:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Successfully detached device vdb from instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 from the live domain config.
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcVBEbAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b07f6a-1315-4edf-984c-02c90847108c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:36 user nova-compute[75409]: No targets found.
Nov 15 21:27:36 user nova-compute[75409]: iSNS:
Nov 15 21:27:36 user nova-compute[75409]: No targets found.
Nov 15 21:27:36 user nova-compute[75409]: STATIC:
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:36 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:36 user nova-compute[75409]: No targets found.
Nov 15 21:27:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:36 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:36 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[431653c3-5c84-4bee-b059-fd95977159eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a224e86-c945-4f2d-abdd-85f82b6455fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:36 user nova-compute[75409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 (non-flash)
Nov 15 21:27:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281c4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308'): ({'sdh'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Removing single pathed devices sdh {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-4ae5441c-a7a1-4794-aadc-eda58c223eee" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-4ae5441c-a7a1-4794-aadc-eda58c223eee" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.objects.instance [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d81fea-3f07-472f-99cd-4d3ac7fbc0ec]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd367b1e-00b7-4e88-9938-d760fbb9f70d]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Flushing IO for device /dev/sdh {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Attempting to detach device tap4ae5441c-a7 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] detach device xml: <interface type="ethernet">
Nov 15 21:27:36 user nova-compute[75409]:   <mac address="fa:16:3e:fa:3c:ae"/>
Nov 15 21:27:36 user nova-compute[75409]:   <model type="virtio"/>
Nov 15 21:27:36 user nova-compute[75409]:   <mtu size="1442"/>
Nov 15 21:27:36 user nova-compute[75409]:   <target dev="tap4ae5441c-a7"/>
Nov 15 21:27:36 user nova-compute[75409]: </interface>
Nov 15 21:27:36 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a210e-7d0f-4960-8d78-f5ff3c456bcc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 21:27:36 user nova-compute[75409]:   <name>instance-00000005</name>
Nov 15 21:27:36 user nova-compute[75409]:   <uuid>43bc3403-fc31-4527-8d38-1138e3f7bf8c</uuid>
Nov 15 21:27:36 user nova-compute[75409]:   <metadata>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:36 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:26:58</nova:creationTime>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:36 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:36 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:36 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:36 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:36 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:36 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:36 user nova-compute[75409]:     <nova:port uuid="4ae5441c-a7a1-4794-aadc-eda58c223eee">
Nov 15 21:27:36 user nova-compute[75409]:       <nova:ip type="fixed" address="10.10.10.201" ipVersion="4"/>
Nov 15 21:27:36 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:36 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:36 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:36 user nova-compute[75409]:   </metadata>
Nov 15 21:27:36 user nova-compute[75409]:   <memory unit='KiB'>524288</memory>
Nov 15 21:27:36 user nova-compute[75409]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 21:27:36 user nova-compute[75409]:   <vcpu placement='static'>1</vcpu>
Nov 15 21:27:36 user nova-compute[75409]:   <resource>
Nov 15 21:27:36 user nova-compute[75409]:     <partition>/machine</partition>
Nov 15 21:27:36 user nova-compute[75409]:   </resource>
Nov 15 21:27:36 user nova-compute[75409]:   <sysinfo type='smbios'>
Nov 15 21:27:36 user nova-compute[75409]:     <system>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='version'>0.0.0</entry>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='serial'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='uuid'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:36 user nova-compute[75409]:       <entry name='family'>Virtual Machine</entry>
Nov 15 21:27:36 user nova-compute[75409]:     </system>
Nov 15 21:27:36 user nova-compute[75409]:   </sysinfo>
Nov 15 21:27:36 user nova-compute[75409]:   <os>
Nov 15 21:27:36 user nova-compute[75409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 21:27:36 user nova-compute[75409]:     <boot dev='hd'/>
Nov 15 21:27:36 user nova-compute[75409]:     <smbios mode='sysinfo'/>
Nov 15 21:27:36 user nova-compute[75409]:   </os>
Nov 15 21:27:36 user nova-compute[75409]:   <features>
Nov 15 21:27:36 user nova-compute[75409]:     <acpi/>
Nov 15 21:27:36 user nova-compute[75409]:     <apic/>
Nov 15 21:27:36 user nova-compute[75409]:     <vmcoreinfo state='on'/>
Nov 15 21:27:36 user nova-compute[75409]:   </features>
Nov 15 21:27:36 user nova-compute[75409]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 21:27:36 user nova-compute[75409]:     <model fallback='forbid'>Nehalem</model>
Nov 15 21:27:36 user nova-compute[75409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 21:27:36 user nova-compute[75409]:     <feature policy='require' name='vme'/>
Nov 15 21:27:36 user nova-compute[75409]:     <feature policy='require' name='x2apic'/>
Nov 15 21:27:36 user nova-compute[75409]:     <feature policy='require' name='hypervisor'/>
Nov 15 21:27:36 user nova-compute[75409]:   </cpu>
Nov 15 21:27:36 user nova-compute[75409]:   <clock offset='utc'>
Nov 15 21:27:36 user nova-compute[75409]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 21:27:36 user nova-compute[75409]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 21:27:36 user nova-compute[75409]:     <timer name='hpet' present='no'/>
Nov 15 21:27:36 user nova-compute[75409]:   </clock>
Nov 15 21:27:36 user nova-compute[75409]:   <on_poweroff>destroy</on_poweroff>
Nov 15 21:27:36 user nova-compute[75409]:   <on_reboot>restart</on_reboot>
Nov 15 21:27:36 user nova-compute[75409]:   <on_crash>destroy</on_crash>
Nov 15 21:27:36 user nova-compute[75409]:   <devices>
Nov 15 21:27:36 user nova-compute[75409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 21:27:36 user nova-compute[75409]:     <disk type='file' device='disk'>
Nov 15 21:27:36 user nova-compute[75409]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 21:27:36 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk' index='2'/>
Nov 15 21:27:36 user nova-compute[75409]:       <backingStore type='file' index='3'>
Nov 15 21:27:36 user nova-compute[75409]:         <format type='raw'/>
Nov 15 21:27:36 user nova-compute[75409]:         <source file='/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573'/>
Nov 15 21:27:36 user nova-compute[75409]:         <backingStore/>
Nov 15 21:27:36 user nova-compute[75409]:       </backingStore>
Nov 15 21:27:36 user nova-compute[75409]:       <target dev='vda' bus='virtio'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='virtio-disk0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </disk>
Nov 15 21:27:36 user nova-compute[75409]:     <disk type='file' device='cdrom'>
Nov 15 21:27:36 user nova-compute[75409]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 21:27:36 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config' index='1'/>
Nov 15 21:27:36 user nova-compute[75409]:       <backingStore/>
Nov 15 21:27:36 user nova-compute[75409]:       <target dev='hda' bus='ide'/>
Nov 15 21:27:36 user nova-compute[75409]:       <readonly/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='ide0-0-0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </disk>
Nov 15 21:27:36 user nova-compute[75409]:     <controller type='usb' index='0' model='none'>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='usb'/>
Nov 15 21:27:36 user nova-compute[75409]:     </controller>
Nov 15 21:27:36 user nova-compute[75409]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='pci.0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </controller>
Nov 15 21:27:36 user nova-compute[75409]:     <controller type='ide' index='0'>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='ide'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 21:27:36 user nova-compute[75409]:     </controller>
Nov 15 21:27:36 user nova-compute[75409]:     <interface type='ethernet'>
Nov 15 21:27:36 user nova-compute[75409]:       <mac address='fa:16:3e:a1:21:08'/>
Nov 15 21:27:36 user nova-compute[75409]:       <target dev='tap2c2af0a6-95'/>
Nov 15 21:27:36 user nova-compute[75409]:       <model type='virtio'/>
Nov 15 21:27:36 user nova-compute[75409]:       <mtu size='1442'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='net0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </interface>
Nov 15 21:27:36 user nova-compute[75409]:     <interface type='ethernet'>
Nov 15 21:27:36 user nova-compute[75409]:       <mac address='fa:16:3e:fa:3c:ae'/>
Nov 15 21:27:36 user nova-compute[75409]:       <target dev='tap4ae5441c-a7'/>
Nov 15 21:27:36 user nova-compute[75409]:       <model type='virtio'/>
Nov 15 21:27:36 user nova-compute[75409]:       <mtu size='1442'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='net1'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </interface>
Nov 15 21:27:36 user nova-compute[75409]:     <serial type='pty'>
Nov 15 21:27:36 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:36 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:36 user nova-compute[75409]:       <target type='isa-serial' port='0'>
Nov 15 21:27:36 user nova-compute[75409]:         <model name='isa-serial'/>
Nov 15 21:27:36 user nova-compute[75409]:       </target>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </serial>
Nov 15 21:27:36 user nova-compute[75409]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 21:27:36 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:36 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:36 user nova-compute[75409]:       <target type='serial' port='0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </console>
Nov 15 21:27:36 user nova-compute[75409]:     <input type='mouse' bus='ps2'>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='input0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </input>
Nov 15 21:27:36 user nova-compute[75409]:     <input type='keyboard' bus='ps2'>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='input1'/>
Nov 15 21:27:36 user nova-compute[75409]:     </input>
Nov 15 21:27:36 user nova-compute[75409]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 21:27:36 user nova-compute[75409]:       <listen type='address' address='0.0.0.0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </graphics>
Nov 15 21:27:36 user nova-compute[75409]:     <audio id='1' type='none'/>
Nov 15 21:27:36 user nova-compute[75409]:     <video>
Nov 15 21:27:36 user nova-compute[75409]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='video0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </video>
Nov 15 21:27:36 user nova-compute[75409]:     <memballoon model='virtio'>
Nov 15 21:27:36 user nova-compute[75409]:       <stats period='10'/>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='balloon0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </memballoon>
Nov 15 21:27:36 user nova-compute[75409]:     <rng model='virtio'>
Nov 15 21:27:36 user nova-compute[75409]:       <backend model='random'>/dev/urandom</backend>
Nov 15 21:27:36 user nova-compute[75409]:       <alias name='rng0'/>
Nov 15 21:27:36 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 21:27:36 user nova-compute[75409]:     </rng>
Nov 15 21:27:36 user nova-compute[75409]:   </devices>
Nov 15 21:27:36 user nova-compute[75409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 21:27:36 user nova-compute[75409]:     <label>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</label>
Nov 15 21:27:36 user nova-compute[75409]:     <imagelabel>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</imagelabel>
Nov 15 21:27:36 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:36 user nova-compute[75409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 21:27:36 user nova-compute[75409]:     <label>+64055:+108</label>
Nov 15 21:27:36 user nova-compute[75409]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 21:27:36 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:36 user nova-compute[75409]: </domain>
Nov 15 21:27:36 user nova-compute[75409]:  {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 21:27:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully detached device tap4ae5441c-a7 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the persistent domain config.
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] (1/8): Attempting to detach device tap4ae5441c-a7 with device alias net1 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] detach device xml: <interface type="ethernet">
Nov 15 21:27:36 user nova-compute[75409]:   <mac address="fa:16:3e:fa:3c:ae"/>
Nov 15 21:27:36 user nova-compute[75409]:   <model type="virtio"/>
Nov 15 21:27:36 user nova-compute[75409]:   <mtu size="1442"/>
Nov 15 21:27:36 user nova-compute[75409]:   <target dev="tap4ae5441c-a7"/>
Nov 15 21:27:36 user nova-compute[75409]: </interface>
Nov 15 21:27:36 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13e8cc-2145-4c4f-b1c7-73f1376c6549]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] SCSI volumes sdh have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d93475d-429f-4a3a-8098-d7dfa141ed95]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[687bd124-578c-40e3-99b1-3cf1e3c37231]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260]
Nov 15 21:27:37 user nova-compute[75409]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d61252-f96b-4cda-a3a6-c4b218589308 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d23ffa-da18-4777-a423-eac84bc672c1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] <== disconnect_volume: return (527ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Start waiting for the detach event from libvirt for device tap4ae5441c-a7 with device alias net1 for instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updated VIF entry in instance network info cache for port be06eaae-06be-4a7b-8fa3-caa1dca1917c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [{"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b4e1dc77-018b-442a-9716-743bbd8d4759 req-95fc82cd-dbc9-4863-9a18-6332143cb380 service nova] Releasing lock "refresh_cache-dfd4714a-e37d-4984-a130-d20cb62578f3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRQvgPJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:37 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:37 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:37 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb0e588-7996-43bc-bad2-e41445fc390a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:37 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac1646-8e89-4e43-9dfe-4c168fcda70a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969] added
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5330ee0-1fad-4dbe-95dc-bd4f19fe9178]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2b2a3-c440-457c-9a8b-e1515f592628]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRQvgPJb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRQvgPJb" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b6a101-d067-4a97-87f0-eafd0a9d95ac]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRQvgPJb'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59872c2e-ded8-4cbc-9415-84e19cbf3321]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd50fb-67cd-4672-ae63-c3b5d0256fde]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[457a5d37-bd30-45f6-97dc-a7a8ed771053]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260]
Nov 15 21:27:37 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[601e6835-dc2e-4dba-b062-e2a94aecf89f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf726b0-f086-478e-b831-10dd1964d3ba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:37 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2782d78c-6638-4f59-99cf-939b38f8b46e]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRQvgPJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.375s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lazy-loading 'flavor' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-def28ba8-2433-484e-a989-9fde94f42043 tempest-VolumesAssistedSnapshotsTest-1007057193 tempest-VolumesAssistedSnapshotsTest-1007057193-project-admin] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.520s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-unplugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-unplugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:38 user nova-compute[75409]: WARNING nova.compute.manager [req-385f2ed4-0dbc-4b9f-b14e-2988db83e134 req-6fb9e840-deec-4833-a106-24730bc264a2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-unplugged-4ae5441c-a7a1-4794-aadc-eda58c223eee for instance with vm_state active and task_state None.
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26562333633653466', 'path': '/dev/sdf'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333633653466', 'path': '/dev/sdf'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:38 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:38 user nova-compute[75409]:   <source dev="/dev/sdf"/>
Nov 15 21:27:38 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:38 user nova-compute[75409]:   <serial>69edd15b-f331-479a-81cc-c00fadaac969</serial>
Nov 15 21:27:38 user nova-compute[75409]: </disk>
Nov 15 21:27:38 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No VIF found with MAC fa:16:3e:f0:98:fd, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:39 user nova-compute[75409]: INFO nova.compute.manager [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Terminating instance
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b478a5a4-6de8-4ae5-ba8f-eef9174c7ff4 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.038s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-261e1721-0689-46ba-a3da-a8fc91213eaf req-9ad58f69-3d6c-4564-b8e0-4738de31ae9d service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-dec4fb56-145e-43d2-9be4-c5d137983604 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: WARNING nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-4ae5441c-a7a1-4794-aadc-eda58c223eee for instance with vm_state active and task_state None.
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: WARNING nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-be06eaae-06be-4a7b-8fa3-caa1dca1917c for instance with vm_state active and task_state deleting.
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-2137497b-7fbd-4bbc-b864-00d1abae473e for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: WARNING nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-2137497b-7fbd-4bbc-b864-00d1abae473e for instance with vm_state active and task_state deleting.
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b2979d7-73ee-4bb2-8019-0d38b02ba5e1 req-bc934e9a-6e60-4121-86cc-da458df4959e service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7e99326a-2e70-4981-89c4-892e82abae98 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:27:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.32684326171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:41 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Instance destroyed successfully.
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lazy-loading 'resources' on Instance uuid dfd4714a-e37d-4984-a130-d20cb62578f3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "address": "fa:16:3e:76:64:be", "network": {"id": "f3164e86-41a9-4d5e-b3eb-a543e0404d83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-262673421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06eaae-06", "ovs_interfaceid": "be06eaae-06be-4a7b-8fa3-caa1dca1917c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe06eaae-06, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b569ec68-f94e-4ce0-a921-fddfa16df1f4) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 498533a9-85ff-4309-bd4c-c97fb406aad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance bac6908e-d641-439c-bb4c-8a86352bb9d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 0208271e-c742-4fb4-8ae8-1fe9907d677b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dfd4714a-e37d-4984-a130-d20cb62578f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3d16138-3e3e-4848-bfcd-d0273f300c86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7f476c5-4d88-464e-adbb-78bad92b0aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:64:be,bridge_name='br-int',has_traffic_filtering=True,id=be06eaae-06be-4a7b-8fa3-caa1dca1917c,network=Network(f3164e86-41a9-4d5e-b3eb-a543e0404d83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06eaae-06')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2137497b-7f, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=996594bc-7387-4e1c-9d52-bcc8453b700d) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:70,bridge_name='br-int',has_traffic_filtering=True,id=2137497b-7fbd-4bbc-b864-00d1abae473e,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2137497b-7f')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e99326a-2e, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a70097e8-62c3-402f-82d7-ec408e5a3059) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f6:a1,bridge_name='br-int',has_traffic_filtering=True,id=7e99326a-2e70-4981-89c4-892e82abae98,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e99326a-2e')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec4fb56-14, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03065acf-5fb8-447a-8762-4971b6532819) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:42 user nova-compute[75409]: WARNING nova.compute.manager [req-8a097496-c578-44de-8d85-3bcdf9979b5b req-6284e581-c667-4be9-9bf7-919ecc677990 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-dec4fb56-145e-43d2-9be4-c5d137983604 for instance with vm_state active and task_state deleting.
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:53:6f,bridge_name='br-int',has_traffic_filtering=True,id=dec4fb56-145e-43d2-9be4-c5d137983604,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec4fb56-14')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c273184-82, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55324b86-5edc-4dee-86d1-0ec035ed85c0) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=7c273184-82d1-4852-84bb-469230dc6348,network=Network(8e910246-31ee-4042-ad0b-fbe59dd3f15e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c273184-82')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7629e08f-74, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56572da0-2509-4173-8764-32d6c0fe98a1) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:5c:3b,bridge_name='br-int',has_traffic_filtering=True,id=7629e08f-74c1-41a2-907f-5d7b6b0b0baa,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629e08f-74')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-664500406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-664500406',id=10,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHsAcnsEht2mrTE4HzG1tAS1IuA5LRg62XyPYuKck/ON7LcdjF1lXXbotuxj1+C16TW3Am6/O/rsKkmFZm5cmXw3MRHOAzMIs/blUtDpwmbnsJ+2QjoHuYPUqQ7uBDwrA==',key_name='tempest-keypair-1392853654',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69baabcae00c484aae8abcc1acbdaa0e',ramdisk_id='',reservation_id='r-wbsmpvh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1511009455',owner_user_name='tempest-TaggedBootDevicesTest_v242-1511009455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d095f7c953144aec82b4ea20dbbcdcc6',uuid=dfd4714a-e37d-4984-a130-d20cb62578f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converting VIF {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7503dd6-ad, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8723a7f-11d4-4632-b35f-309d3b697c6c) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:42 user nova-compute[75409]: INFO os_vif [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:0a:0f,bridge_name='br-int',has_traffic_filtering=True,id=d7503dd6-ad9a-4dca-a387-2cefce9e784c,network=Network(40a75d44-b726-4875-a5a3-066c9d2eb7f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7503dd6-ad')
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skTbUNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:42 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83a230-e060-4431-a53e-cd894b644c02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:42 user nova-compute[75409]: No targets found.
Nov 15 21:27:42 user nova-compute[75409]: iSNS:
Nov 15 21:27:42 user nova-compute[75409]: No targets found.
Nov 15 21:27:42 user nova-compute[75409]: STATIC:
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:27:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:42 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:42 user nova-compute[75409]: No targets found.
Nov 15 21:27:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:42 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:42 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875f0c8-6043-4143-af10-253b992d0445]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[943772af-cd36-4f7d-9850-51ab5e8d54a2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:42 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf286d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24510f1-ea43-453a-92eb-6725dc0c567f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e9d98-e9f8-4b2d-95d5-85f68b835347]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba0859-49c1-4a60-a170-7488216e3b09]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:42 user nova-compute[75409]: WARNING nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7e99326a-2e70-4981-89c4-892e82abae98 for instance with vm_state active and task_state deleting.
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:42 user nova-compute[75409]: WARNING nova.compute.manager [req-f8f4f5d7-d210-4df8-9d56-e28951e3bf38 req-a84e8207-9597-4025-8c2d-f6b4abdc8946 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7629e08f-74c1-41a2-907f-5d7b6b0b0baa for instance with vm_state active and task_state deleting.
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90712df8-bc2b-471c-8204-3818a94dc07c]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b104ad-c038-4330-ac07-82c5197de143]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[095f0e30-c64d-4f87-b8d8-18ae8cbd214f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260]
Nov 15 21:27:43 user nova-compute[75409]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a21b7-9c42-49a9-b9a3-af51be173b09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d7c88-8535-46d7-a9a7-a55b69492de6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== disconnect_volume: return (370ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoMCeQuB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:43 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8920ee4-36d6-4192-b2c6-47dd05f0ccfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]: iSNS:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]: STATIC:
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:43 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:43 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e541ac-6ca1-4240-a6b9-7255a407b339]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3dc28-2a2b-4dc2-bf1e-d7cc11ff7908]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf286d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4796ae-3e98-4b0f-8768-924dda3d2a4d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dbc76-f1ea-42b3-89a3-08fb6e20573e]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7153a5-27fd-4fd5-a833-65b57ebe7045]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c537b-7cf2-4e3a-a921-b550ef2d2a78]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4ad2e5-9755-425f-b666-babe0ab602e6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2078c3d4-d9dc-4968-a153-0848492bb1be]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260]
Nov 15 21:27:43 user nova-compute[75409]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb851e4-5923-4902-a52d-1ba92a864fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc37fcc-a379-4044-955e-04d78c092cf1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== disconnect_volume: return (354ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDHjGFOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:43 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d54f1-2a74-4c39-9af4-bbf7abe297bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]: iSNS:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]: STATIC:
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:27:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:43 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:43 user nova-compute[75409]: No targets found.
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:43 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:43 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb36a8-0d10-4ed7-bd1a-09abc3eb1ced]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[725edd18-b224-48ed-8da4-b0a3367eec95]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:43 user nova-compute[75409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf (non-flash)
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28555ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b047e2e7-0663-4cf7-ae17-9bc101b6c559]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-f92a15e0-6500-4168-905a-b33812f8a48b req-8907462a-d961-4817-8221-afec6e029b43 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-7c273184-82d1-4852-84bb-469230dc6348 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d8335-24db-4048-97c0-0761adecbf5d]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a537804-99b0-42a0-89f7-00cb0c06fb92]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceb2fa9-140f-406c-b5d5-300e1315817e]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb490b-d6cb-4c3b-a72c-01ba4399f38c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b5d802-2736-4c30-bf4a-7570354056ed]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260]
Nov 15 21:27:43 user nova-compute[75409]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a4df1f-6541-4425-af34-4477ec7338bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91087ab4-1b56-4f15-85e6-0a3c17b0571d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] <== disconnect_volume: return (342ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Deleting instance files /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3_del
Nov 15 21:27:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Deletion of /opt/stack/data/nova/instances/dfd4714a-e37d-4984-a130-d20cb62578f3_del complete
Nov 15 21:27:43 user nova-compute[75409]: INFO nova.compute.manager [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Took 4.45 seconds to destroy the instance on the hypervisor.
Nov 15 21:27:43 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:27:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:44 user nova-compute[75409]: INFO nova.compute.manager [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attaching volume fcad9133-549d-4c83-ac76-69b44a6a0a92 to /dev/vdc
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.utils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3d65bb-dcbf-4e40-8a9d-d77c8c012b9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435e6be-a2c8-4d43-ba12-507e6506c36e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf5c51-2963-442f-aab4-e897baf57785]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0434b8-fd22-4df4-8571-e8ca07e06ff6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:44 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf99031-aa5a-4895-b194-248f5aa7cb38]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG os_brick.utils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:44 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating existing volume attachment record: eef9171d-1a3b-4c9d-b613-1088bdb1b07a {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-changed-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Refreshing instance network info cache due to event network-changed-d37ff7cb-9750-44bc-976c-309de6f3d691. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] Acquiring lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] Acquired lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Refreshing network info cache for port d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.objects.instance [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Ignoring supplied device name: /dev/vdb
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:45 user nova-compute[75409]: WARNING nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-7c273184-82d1-4852-84bb-469230dc6348 for instance with vm_state active and task_state deleting.
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-unplugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-unplugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Acquiring lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] No waiting events found dispatching network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:45 user nova-compute[75409]: WARNING nova.compute.manager [req-48496ec8-b785-4719-93c1-d629410d80f3 req-0e9d4d16-cc19-4aaa-90ac-249f6e436e40 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received unexpected event network-vif-plugged-d7503dd6-ad9a-4dca-a387-2cefce9e784c for instance with vm_state active and task_state deleting.
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updated VIF entry in instance network info cache for port d37ff7cb-9750-44bc-976c-309de6f3d691. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updating instance_info_cache with network_info: [{"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fbb15b60-4150-4212-90e3-f6aa3cb77175 req-8f87cbb6-b30a-404a-b8e0-2d4b67c29ce6 service nova] Releasing lock "refresh_cache-f3d16138-3e3e-4848-bfcd-d0273f300c86" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:45 user nova-compute[75409]: INFO nova.compute.manager [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Attaching volume ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec to /dev/vdb
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.utils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c2b68-85c8-465f-9e0f-a4ed7802da81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1abce9-545b-4c7a-b225-7605b78e57b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c4ab2-e305-43ad-96ec-74c48c4b6628]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713f3ff-d590-42ec-9c42-d9b8d0a101aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:27:45 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:27:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a28e1-d924-4ef7-b82b-df2cc4907a76]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG os_brick.utils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:45 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updating existing volume attachment record: 993c42a5-12a9-4df7-93d2-ea65e51de205 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:27:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-395c3313-156b-4660-9485-d1f22c54d4bc req-f339ecb9-da04-428d-be91-b4c840156ad4 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-deleted-be06eaae-06be-4a7b-8fa3-caa1dca1917c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:46 user nova-compute[75409]: INFO nova.compute.manager [req-395c3313-156b-4660-9485-d1f22c54d4bc req-f339ecb9-da04-428d-be91-b4c840156ad4 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Neutron deleted interface be06eaae-06be-4a7b-8fa3-caa1dca1917c; detaching it from the instance and deleting it from the info cache
Nov 15 21:27:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-395c3313-156b-4660-9485-d1f22c54d4bc req-f339ecb9-da04-428d-be91-b4c840156ad4 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [{"id": "2137497b-7fbd-4bbc-b864-00d1abae473e", "address": "fa:16:3e:9b:31:70", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2137497b-7f", "ovs_interfaceid": "2137497b-7fbd-4bbc-b864-00d1abae473e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e99326a-2e70-4981-89c4-892e82abae98", "address": "fa:16:3e:68:f6:a1", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99326a-2e", "ovs_interfaceid": "7e99326a-2e70-4981-89c4-892e82abae98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec4fb56-145e-43d2-9be4-c5d137983604", "address": "fa:16:3e:5f:53:6f", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec4fb56-14", "ovs_interfaceid": "dec4fb56-145e-43d2-9be4-c5d137983604", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c273184-82d1-4852-84bb-469230dc6348", "address": "fa:16:3e:3d:d2:89", "network": {"id": "8e910246-31ee-4042-ad0b-fbe59dd3f15e", "bridge": "br-int", "label": "tempest-device-tagging-net1-243591949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c273184-82", "ovs_interfaceid": "7c273184-82d1-4852-84bb-469230dc6348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "address": "fa:16:3e:5e:5c:3b", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629e08f-74", "ovs_interfaceid": "7629e08f-74c1-41a2-907f-5d7b6b0b0baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "address": "fa:16:3e:46:0a:0f", "network": {"id": "40a75d44-b726-4875-a5a3-066c9d2eb7f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1756874794", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69baabcae00c484aae8abcc1acbdaa0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7503dd6-ad", "ovs_interfaceid": "d7503dd6-ad9a-4dca-a387-2cefce9e784c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-395c3313-156b-4660-9485-d1f22c54d4bc req-f339ecb9-da04-428d-be91-b4c840156ad4 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Detach interface failed, port_id=be06eaae-06be-4a7b-8fa3-caa1dca1917c, reason: Instance dfd4714a-e37d-4984-a130-d20cb62578f3 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:27:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:48 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:48 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Took 4.40 seconds to deallocate network for instance.
Nov 15 21:27:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-a095fe63-c292-4d2e-a328-b338f87bcb1f req-b031af62-d512-4eaa-9911-1aec496443a0 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-deleted-7c273184-82d1-4852-84bb-469230dc6348 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-a095fe63-c292-4d2e-a328-b338f87bcb1f req-b031af62-d512-4eaa-9911-1aec496443a0 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-deleted-d7503dd6-ad9a-4dca-a387-2cefce9e784c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-a095fe63-c292-4d2e-a328-b338f87bcb1f req-b031af62-d512-4eaa-9911-1aec496443a0 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-deleted-dec4fb56-145e-43d2-9be4-c5d137983604 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-a095fe63-c292-4d2e-a328-b338f87bcb1f req-b031af62-d512-4eaa-9911-1aec496443a0 service nova] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Received event network-vif-deleted-7629e08f-74c1-41a2-907f-5d7b6b0b0baa {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LitaQsHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:50 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:50 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:50 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10a77d-b1a2-4032-a201-c51a99e058f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:50 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8f2a9-cea3-42d7-886c-f97786d07056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92] added
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6c10ce-177d-496c-a12e-03313e664128]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd3eb28-ad08-452c-8f0a-7f4ce4d53912]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LitaQsHY {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LitaQsHY" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6b776-ee47-4303-be52-c9bd28df0dae]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LitaQsHY'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1222d1-bd69-4c5d-a8d8-40db2c23dd9b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e985bc-36db-481e-9340-36067299bee9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e39579-a9a6-489b-99aa-694c6dc513cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260]
Nov 15 21:27:50 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1de77-0c62-4459-a277-621fd57f643c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: INFO nova.compute.manager [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] [instance: dfd4714a-e37d-4984-a130-d20cb62578f3] Took 2.52 seconds to detach 3 volumes for instance.
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b552e9-f7c8-420c-b784-af9b9d497072]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d997004-8996-49e5-90e3-2656390d075b]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LitaQsHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:51 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Deleted allocations for instance dfd4714a-e37d-4984-a130-d20cb62578f3
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f0221e7-8acc-457a-8b90-34913c0f83df tempest-TaggedBootDevicesTest_v242-1511009455 tempest-TaggedBootDevicesTest_v242-1511009455-project-member] Lock "dfd4714a-e37d-4984-a130-d20cb62578f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.938s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsCtRWEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:51 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:51 user nova-compute[75409]: INFO nova.compute.manager [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Terminating instance
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26363643234373934', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643234373934', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.465s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:51 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:51 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:27:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2fdf7-a085-46a7-9163-7265705a5d93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:27:51 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:51 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:51 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:27:51 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:27:51 user nova-compute[75409]:   <serial>fcad9133-549d-4c83-ac76-69b44a6a0a92</serial>
Nov 15 21:27:51 user nova-compute[75409]: </disk>
Nov 15 21:27:51 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c42ff-2c75-4c3c-84a8-38961cc16433]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec] added
Nov 15 21:27:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d587ac81-b5a0-4f4a-b174-29101810fa7a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7433c21-bc8f-4f13-b6d0-4559c2d1330b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsCtRWEL {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsCtRWEL" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80bc6d-dd26-4bcf-b186-37625cc933ea]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rsCtRWEL'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860d845-1688-4848-8db9-2b02f539c0d2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-unplugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] No waiting events found dispatching network-vif-unplugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-ecc5c332-5fed-4efd-b4da-b6225f149666 req-a30ccbaa-286a-436d-b32b-f3f327a83305 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-unplugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e17e98c-c603-4527-a9f4-af61e3e0eda8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 498533a9-85ff-4309-bd4c-c97fb406aad0 is timed out.
Nov 15 21:27:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Successfully detached device vdb from instance 498533a9-85ff-4309-bd4c-c97fb406aad0 from the live domain config.
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvqaobEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '77f0954b-0d41-4112-b199-1924c20b59de'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:27:52 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c366aa8b-a5be-4e29-a23a-82e36a0d9c92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260]
Nov 15 21:27:52 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2dde2-45a1-43ee-8ae1-e15f1e236b56]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de2e794-490e-4e96-b969-5c32af916241]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:27:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:52 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:27:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca085689-b29e-474f-b3cd-58f529fc92f3]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] No VIF found with MAC fa:16:3e:f0:98:fd, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e29abd28-a67a-4661-a1dc-65d6bcaf2aea tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.686s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Instance destroyed successfully.
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lazy-loading 'resources' on Instance uuid c7f476c5-4d88-464e-adbb-78bad92b0aa9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:26:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-955419460',display_name='tempest-VolumesActionsTest-instance-955419460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-955419460',id=12,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-94nm2yfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:08Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=c7f476c5-4d88-464e-adbb-78bad92b0aa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "address": "fa:16:3e:cf:b5:4e", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27eaa11a-3b", "ovs_interfaceid": "27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG os_vif [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27eaa11a-3b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2159c3cb-2570-4105-8c0b-cf02ffbaec61) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:52 user nova-compute[75409]: INFO os_vif [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b5:4e,bridge_name='br-int',has_traffic_filtering=True,id=27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27eaa11a-3b')
Nov 15 21:27:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Deleting instance files /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9_del
Nov 15 21:27:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Deletion of /opt/stack/data/nova/instances/c7f476c5-4d88-464e-adbb-78bad92b0aa9_del complete
Nov 15 21:27:52 user nova-compute[75409]: INFO nova.compute.manager [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 21:27:52 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:27:52 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsCtRWEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== connect_volume: return (1852ms) {'type': 'block', 'scsi_wwn': '26330326330346465', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330326330346465', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.124s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.objects.instance [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57545fb-146b-43fb-b7ef-a1b2127dceca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:27:53 user nova-compute[75409]: No targets found.
Nov 15 21:27:53 user nova-compute[75409]: iSNS:
Nov 15 21:27:53 user nova-compute[75409]: No targets found.
Nov 15 21:27:53 user nova-compute[75409]: STATIC:
Nov 15 21:27:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec
Nov 15 21:27:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92
Nov 15 21:27:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:27:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de
Nov 15 21:27:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:27:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:27:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:27:53 user nova-compute[75409]: FIRMWARE:
Nov 15 21:27:53 user nova-compute[75409]: No targets found.
Nov 15 21:27:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:27:53 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:27:53 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Took 0.54 seconds to deallocate network for instance.
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:27:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:53 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:27:53 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:27:53 user nova-compute[75409]:   <serial>ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec</serial>
Nov 15 21:27:53 user nova-compute[75409]: </disk>
Nov 15 21:27:53 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ea73a-d774-4716-a86d-7e5963577f7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4048d329-c4fe-4e05-b20a-951e27896bac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:27:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:27:53 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:27:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf481017e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de'): ({'sdi'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Removing single pathed devices sdi {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[272abe97-acbc-436b-bf37-c019b7bfcc83]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b34cb3-41c3-492a-bb71-99ef69cd86c6]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Flushing IO for device /dev/sdi {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4379bb-a412-42d1-90d5-2e54ca89b59b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828a3ca-0373-46a5-8a96-fc8d051e6a44]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] SCSI volumes sdi have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e102dfb-74c7-4fdc-93af-024eda34dd35]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72cbc57-5bb2-4f2a-84cc-479613a8a2c2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260]
Nov 15 21:27:53 user nova-compute[75409]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de, portal: 172.16.0.220,3260] successful.
Nov 15 21:27:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0954b-0d41-4112-b199-1924c20b59de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d78e7f-be54-4554-a5fc-cc24f67c2512]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] <== disconnect_volume: return (1471ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:53 user nova-compute[75409]: INFO nova.compute.manager [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Detaching volume fcad9133-549d-4c83-ac76-69b44a6a0a92
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No VIF found with MAC fa:16:3e:87:18:1c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:27:53 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Deleted allocations for instance c7f476c5-4d88-464e-adbb-78bad92b0aa9
Nov 15 21:27:53 user nova-compute[75409]: INFO nova.virt.block_device [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attempting to driver detach volume fcad9133-549d-4c83-ac76-69b44a6a0a92 from mountpoint /dev/vdc
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Attempting to detach device vdc from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:53 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:27:53 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:27:53 user nova-compute[75409]:   <serial>fcad9133-549d-4c83-ac76-69b44a6a0a92</serial>
Nov 15 21:27:53 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:27:53 user nova-compute[75409]: </disk>
Nov 15 21:27:53 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully detached device vdc from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the persistent domain config.
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:27:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:27:53 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:27:53 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:27:53 user nova-compute[75409]:   <serial>fcad9133-549d-4c83-ac76-69b44a6a0a92</serial>
Nov 15 21:27:53 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:27:53 user nova-compute[75409]: </disk>
Nov 15 21:27:53 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-92ae32b5-65c1-42d4-b4be-a37c57395c66 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-12cd3d00-c492-488f-b0d5-a01c415084bb tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.137s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] Acquiring lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] Lock "c7f476c5-4d88-464e-adbb-78bad92b0aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] No waiting events found dispatching network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:27:54 user nova-compute[75409]: WARNING nova.compute.manager [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received unexpected event network-vif-plugged-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 for instance with vm_state deleted and task_state None.
Nov 15 21:27:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-625c01d5-9e1d-4ad0-9c17-d75a9dbdb591 req-41f1ade9-5ddb-41e6-909f-c56b2542eed5 service nova] [instance: c7f476c5-4d88-464e-adbb-78bad92b0aa9] Received event network-vif-deleted-27eaa11a-3bf7-4dd5-a7fe-ec66da1a4380 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lazy-loading 'flavor' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30be0856-9699-45ec-ba24-3b6d7fe7f73f tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.879s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Waiting for libvirt event about the detach of device tap4ae5441c-a7 with device alias net1 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c is timed out.
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 21:27:57 user nova-compute[75409]:   <name>instance-00000005</name>
Nov 15 21:27:57 user nova-compute[75409]:   <uuid>43bc3403-fc31-4527-8d38-1138e3f7bf8c</uuid>
Nov 15 21:27:57 user nova-compute[75409]:   <metadata>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:57 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:26:58</nova:creationTime>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:57 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="4ae5441c-a7a1-4794-aadc-eda58c223eee">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.10.10.201" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:57 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:57 user nova-compute[75409]:   </metadata>
Nov 15 21:27:57 user nova-compute[75409]:   <memory unit='KiB'>524288</memory>
Nov 15 21:27:57 user nova-compute[75409]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 21:27:57 user nova-compute[75409]:   <vcpu placement='static'>1</vcpu>
Nov 15 21:27:57 user nova-compute[75409]:   <resource>
Nov 15 21:27:57 user nova-compute[75409]:     <partition>/machine</partition>
Nov 15 21:27:57 user nova-compute[75409]:   </resource>
Nov 15 21:27:57 user nova-compute[75409]:   <sysinfo type='smbios'>
Nov 15 21:27:57 user nova-compute[75409]:     <system>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='version'>0.0.0</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='serial'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='uuid'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='family'>Virtual Machine</entry>
Nov 15 21:27:57 user nova-compute[75409]:     </system>
Nov 15 21:27:57 user nova-compute[75409]:   </sysinfo>
Nov 15 21:27:57 user nova-compute[75409]:   <os>
Nov 15 21:27:57 user nova-compute[75409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 21:27:57 user nova-compute[75409]:     <boot dev='hd'/>
Nov 15 21:27:57 user nova-compute[75409]:     <smbios mode='sysinfo'/>
Nov 15 21:27:57 user nova-compute[75409]:   </os>
Nov 15 21:27:57 user nova-compute[75409]:   <features>
Nov 15 21:27:57 user nova-compute[75409]:     <acpi/>
Nov 15 21:27:57 user nova-compute[75409]:     <apic/>
Nov 15 21:27:57 user nova-compute[75409]:     <vmcoreinfo state='on'/>
Nov 15 21:27:57 user nova-compute[75409]:   </features>
Nov 15 21:27:57 user nova-compute[75409]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 21:27:57 user nova-compute[75409]:     <model fallback='forbid'>Nehalem</model>
Nov 15 21:27:57 user nova-compute[75409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='vme'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='x2apic'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='hypervisor'/>
Nov 15 21:27:57 user nova-compute[75409]:   </cpu>
Nov 15 21:27:57 user nova-compute[75409]:   <clock offset='utc'>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='hpet' present='no'/>
Nov 15 21:27:57 user nova-compute[75409]:   </clock>
Nov 15 21:27:57 user nova-compute[75409]:   <on_poweroff>destroy</on_poweroff>
Nov 15 21:27:57 user nova-compute[75409]:   <on_reboot>restart</on_reboot>
Nov 15 21:27:57 user nova-compute[75409]:   <on_crash>destroy</on_crash>
Nov 15 21:27:57 user nova-compute[75409]:   <devices>
Nov 15 21:27:57 user nova-compute[75409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='disk'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk' index='2'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore type='file' index='3'>
Nov 15 21:27:57 user nova-compute[75409]:         <format type='raw'/>
Nov 15 21:27:57 user nova-compute[75409]:         <source file='/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573'/>
Nov 15 21:27:57 user nova-compute[75409]:         <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       </backingStore>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='vda' bus='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='virtio-disk0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='cdrom'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config' index='1'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='hda' bus='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <readonly/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide0-0-0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='usb' index='0' model='none'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='usb'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='pci.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='ide' index='0'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <interface type='ethernet'>
Nov 15 21:27:57 user nova-compute[75409]:       <mac address='fa:16:3e:a1:21:08'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='tap2c2af0a6-95'/>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <mtu size='1442'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='net0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </interface>
Nov 15 21:27:57 user nova-compute[75409]:     <serial type='pty'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='isa-serial' port='0'>
Nov 15 21:27:57 user nova-compute[75409]:         <model name='isa-serial'/>
Nov 15 21:27:57 user nova-compute[75409]:       </target>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </serial>
Nov 15 21:27:57 user nova-compute[75409]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='serial' port='0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </console>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='mouse' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='keyboard' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 21:27:57 user nova-compute[75409]:       <listen type='address' address='0.0.0.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </graphics>
Nov 15 21:27:57 user nova-compute[75409]:     <audio id='1' type='none'/>
Nov 15 21:27:57 user nova-compute[75409]:     <video>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='video0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </video>
Nov 15 21:27:57 user nova-compute[75409]:     <memballoon model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <stats period='10'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='balloon0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </memballoon>
Nov 15 21:27:57 user nova-compute[75409]:     <rng model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <backend model='random'>/dev/urandom</backend>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='rng0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </rng>
Nov 15 21:27:57 user nova-compute[75409]:   </devices>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>+64055:+108</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]: </domain>
Nov 15 21:27:57 user nova-compute[75409]:  {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 21:27:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully detached device tap4ae5441c-a7 from instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c from the live domain config.
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG os_vif [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae5441c-a7, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e302abe3-8346-4b2d-97a9-983724c59b73) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:27:57 user nova-compute[75409]: INFO os_vif [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7')
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:57 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:27:57</nova:creationTime>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:57 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:57 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:57 user nova-compute[75409]:  {{(pid=75409) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-deleted-4ae5441c-a7a1-4794-aadc-eda58c223eee {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:27:57 user nova-compute[75409]: INFO nova.compute.manager [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Neutron deleted interface 4ae5441c-a7a1-4794-aadc-eda58c223eee; detaching it from the instance and deleting it from the info cache
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquired lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.objects.instance [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Lazy-loading 'system_metadata' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.objects.instance [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Lazy-loading 'flavor' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.objects.base [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Object Instance<43bc3403-fc31-4527-8d38-1138e3f7bf8c> lazy-loaded attributes: system_metadata,flavor {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 21:27:57 user nova-compute[75409]:   <name>instance-00000005</name>
Nov 15 21:27:57 user nova-compute[75409]:   <uuid>43bc3403-fc31-4527-8d38-1138e3f7bf8c</uuid>
Nov 15 21:27:57 user nova-compute[75409]:   <metadata>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:57 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:27:57</nova:creationTime>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:57 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:57 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:57 user nova-compute[75409]:   </metadata>
Nov 15 21:27:57 user nova-compute[75409]:   <memory unit='KiB'>524288</memory>
Nov 15 21:27:57 user nova-compute[75409]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 21:27:57 user nova-compute[75409]:   <vcpu placement='static'>1</vcpu>
Nov 15 21:27:57 user nova-compute[75409]:   <resource>
Nov 15 21:27:57 user nova-compute[75409]:     <partition>/machine</partition>
Nov 15 21:27:57 user nova-compute[75409]:   </resource>
Nov 15 21:27:57 user nova-compute[75409]:   <sysinfo type='smbios'>
Nov 15 21:27:57 user nova-compute[75409]:     <system>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='version'>0.0.0</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='serial'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='uuid'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='family'>Virtual Machine</entry>
Nov 15 21:27:57 user nova-compute[75409]:     </system>
Nov 15 21:27:57 user nova-compute[75409]:   </sysinfo>
Nov 15 21:27:57 user nova-compute[75409]:   <os>
Nov 15 21:27:57 user nova-compute[75409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 21:27:57 user nova-compute[75409]:     <boot dev='hd'/>
Nov 15 21:27:57 user nova-compute[75409]:     <smbios mode='sysinfo'/>
Nov 15 21:27:57 user nova-compute[75409]:   </os>
Nov 15 21:27:57 user nova-compute[75409]:   <features>
Nov 15 21:27:57 user nova-compute[75409]:     <acpi/>
Nov 15 21:27:57 user nova-compute[75409]:     <apic/>
Nov 15 21:27:57 user nova-compute[75409]:     <vmcoreinfo state='on'/>
Nov 15 21:27:57 user nova-compute[75409]:   </features>
Nov 15 21:27:57 user nova-compute[75409]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 21:27:57 user nova-compute[75409]:     <model fallback='forbid'>Nehalem</model>
Nov 15 21:27:57 user nova-compute[75409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='vme'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='x2apic'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='hypervisor'/>
Nov 15 21:27:57 user nova-compute[75409]:   </cpu>
Nov 15 21:27:57 user nova-compute[75409]:   <clock offset='utc'>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='hpet' present='no'/>
Nov 15 21:27:57 user nova-compute[75409]:   </clock>
Nov 15 21:27:57 user nova-compute[75409]:   <on_poweroff>destroy</on_poweroff>
Nov 15 21:27:57 user nova-compute[75409]:   <on_reboot>restart</on_reboot>
Nov 15 21:27:57 user nova-compute[75409]:   <on_crash>destroy</on_crash>
Nov 15 21:27:57 user nova-compute[75409]:   <devices>
Nov 15 21:27:57 user nova-compute[75409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='disk'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk' index='2'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore type='file' index='3'>
Nov 15 21:27:57 user nova-compute[75409]:         <format type='raw'/>
Nov 15 21:27:57 user nova-compute[75409]:         <source file='/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573'/>
Nov 15 21:27:57 user nova-compute[75409]:         <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       </backingStore>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='vda' bus='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='virtio-disk0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='cdrom'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config' index='1'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='hda' bus='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <readonly/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide0-0-0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='usb' index='0' model='none'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='usb'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='pci.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='ide' index='0'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <interface type='ethernet'>
Nov 15 21:27:57 user nova-compute[75409]:       <mac address='fa:16:3e:a1:21:08'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='tap2c2af0a6-95'/>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <mtu size='1442'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='net0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </interface>
Nov 15 21:27:57 user nova-compute[75409]:     <serial type='pty'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='isa-serial' port='0'>
Nov 15 21:27:57 user nova-compute[75409]:         <model name='isa-serial'/>
Nov 15 21:27:57 user nova-compute[75409]:       </target>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </serial>
Nov 15 21:27:57 user nova-compute[75409]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='serial' port='0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </console>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='mouse' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='keyboard' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 21:27:57 user nova-compute[75409]:       <listen type='address' address='0.0.0.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </graphics>
Nov 15 21:27:57 user nova-compute[75409]:     <audio id='1' type='none'/>
Nov 15 21:27:57 user nova-compute[75409]:     <video>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='video0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </video>
Nov 15 21:27:57 user nova-compute[75409]:     <memballoon model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <stats period='10'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='balloon0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </memballoon>
Nov 15 21:27:57 user nova-compute[75409]:     <rng model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <backend model='random'>/dev/urandom</backend>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='rng0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </rng>
Nov 15 21:27:57 user nova-compute[75409]:   </devices>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>+64055:+108</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]: </domain>
Nov 15 21:27:57 user nova-compute[75409]:  {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface> {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:3c:ae"/><model type="virtio"/><mtu size="1442"/><target dev="tap4ae5441c-a7"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 21:27:57 user nova-compute[75409]:   <name>instance-00000005</name>
Nov 15 21:27:57 user nova-compute[75409]:   <uuid>43bc3403-fc31-4527-8d38-1138e3f7bf8c</uuid>
Nov 15 21:27:57 user nova-compute[75409]:   <metadata>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:57 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:27:57</nova:creationTime>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:57 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:57 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:57 user nova-compute[75409]:   </metadata>
Nov 15 21:27:57 user nova-compute[75409]:   <memory unit='KiB'>524288</memory>
Nov 15 21:27:57 user nova-compute[75409]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 21:27:57 user nova-compute[75409]:   <vcpu placement='static'>1</vcpu>
Nov 15 21:27:57 user nova-compute[75409]:   <resource>
Nov 15 21:27:57 user nova-compute[75409]:     <partition>/machine</partition>
Nov 15 21:27:57 user nova-compute[75409]:   </resource>
Nov 15 21:27:57 user nova-compute[75409]:   <sysinfo type='smbios'>
Nov 15 21:27:57 user nova-compute[75409]:     <system>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='version'>0.0.0</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='serial'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='uuid'>43bc3403-fc31-4527-8d38-1138e3f7bf8c</entry>
Nov 15 21:27:57 user nova-compute[75409]:       <entry name='family'>Virtual Machine</entry>
Nov 15 21:27:57 user nova-compute[75409]:     </system>
Nov 15 21:27:57 user nova-compute[75409]:   </sysinfo>
Nov 15 21:27:57 user nova-compute[75409]:   <os>
Nov 15 21:27:57 user nova-compute[75409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 21:27:57 user nova-compute[75409]:     <boot dev='hd'/>
Nov 15 21:27:57 user nova-compute[75409]:     <smbios mode='sysinfo'/>
Nov 15 21:27:57 user nova-compute[75409]:   </os>
Nov 15 21:27:57 user nova-compute[75409]:   <features>
Nov 15 21:27:57 user nova-compute[75409]:     <acpi/>
Nov 15 21:27:57 user nova-compute[75409]:     <apic/>
Nov 15 21:27:57 user nova-compute[75409]:     <vmcoreinfo state='on'/>
Nov 15 21:27:57 user nova-compute[75409]:   </features>
Nov 15 21:27:57 user nova-compute[75409]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 21:27:57 user nova-compute[75409]:     <model fallback='forbid'>Nehalem</model>
Nov 15 21:27:57 user nova-compute[75409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='vme'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='x2apic'/>
Nov 15 21:27:57 user nova-compute[75409]:     <feature policy='require' name='hypervisor'/>
Nov 15 21:27:57 user nova-compute[75409]:   </cpu>
Nov 15 21:27:57 user nova-compute[75409]:   <clock offset='utc'>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 21:27:57 user nova-compute[75409]:     <timer name='hpet' present='no'/>
Nov 15 21:27:57 user nova-compute[75409]:   </clock>
Nov 15 21:27:57 user nova-compute[75409]:   <on_poweroff>destroy</on_poweroff>
Nov 15 21:27:57 user nova-compute[75409]:   <on_reboot>restart</on_reboot>
Nov 15 21:27:57 user nova-compute[75409]:   <on_crash>destroy</on_crash>
Nov 15 21:27:57 user nova-compute[75409]:   <devices>
Nov 15 21:27:57 user nova-compute[75409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='disk'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk' index='2'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore type='file' index='3'>
Nov 15 21:27:57 user nova-compute[75409]:         <format type='raw'/>
Nov 15 21:27:57 user nova-compute[75409]:         <source file='/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573'/>
Nov 15 21:27:57 user nova-compute[75409]:         <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       </backingStore>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='vda' bus='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='virtio-disk0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <disk type='file' device='cdrom'>
Nov 15 21:27:57 user nova-compute[75409]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 21:27:57 user nova-compute[75409]:       <source file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/disk.config' index='1'/>
Nov 15 21:27:57 user nova-compute[75409]:       <backingStore/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='hda' bus='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <readonly/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide0-0-0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </disk>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='usb' index='0' model='none'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='usb'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='pci.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <controller type='ide' index='0'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='ide'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </controller>
Nov 15 21:27:57 user nova-compute[75409]:     <interface type='ethernet'>
Nov 15 21:27:57 user nova-compute[75409]:       <mac address='fa:16:3e:a1:21:08'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target dev='tap2c2af0a6-95'/>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio'/>
Nov 15 21:27:57 user nova-compute[75409]:       <mtu size='1442'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='net0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </interface>
Nov 15 21:27:57 user nova-compute[75409]:     <serial type='pty'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='isa-serial' port='0'>
Nov 15 21:27:57 user nova-compute[75409]:         <model name='isa-serial'/>
Nov 15 21:27:57 user nova-compute[75409]:       </target>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </serial>
Nov 15 21:27:57 user nova-compute[75409]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 21:27:57 user nova-compute[75409]:       <source path='/dev/pts/4'/>
Nov 15 21:27:57 user nova-compute[75409]:       <log file='/opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c/console.log' append='off'/>
Nov 15 21:27:57 user nova-compute[75409]:       <target type='serial' port='0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='serial0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </console>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='mouse' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <input type='keyboard' bus='ps2'>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='input1'/>
Nov 15 21:27:57 user nova-compute[75409]:     </input>
Nov 15 21:27:57 user nova-compute[75409]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 21:27:57 user nova-compute[75409]:       <listen type='address' address='0.0.0.0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </graphics>
Nov 15 21:27:57 user nova-compute[75409]:     <audio id='1' type='none'/>
Nov 15 21:27:57 user nova-compute[75409]:     <video>
Nov 15 21:27:57 user nova-compute[75409]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='video0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </video>
Nov 15 21:27:57 user nova-compute[75409]:     <memballoon model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <stats period='10'/>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='balloon0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </memballoon>
Nov 15 21:27:57 user nova-compute[75409]:     <rng model='virtio'>
Nov 15 21:27:57 user nova-compute[75409]:       <backend model='random'>/dev/urandom</backend>
Nov 15 21:27:57 user nova-compute[75409]:       <alias name='rng0'/>
Nov 15 21:27:57 user nova-compute[75409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 21:27:57 user nova-compute[75409]:     </rng>
Nov 15 21:27:57 user nova-compute[75409]:   </devices>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>libvirt-43bc3403-fc31-4527-8d38-1138e3f7bf8c</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 21:27:57 user nova-compute[75409]:     <label>+64055:+108</label>
Nov 15 21:27:57 user nova-compute[75409]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 21:27:57 user nova-compute[75409]:   </seclabel>
Nov 15 21:27:57 user nova-compute[75409]: </domain>
Nov 15 21:27:57 user nova-compute[75409]:  {{(pid=75409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 21:27:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Detaching interface fa:16:3e:fa:3c:ae failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4ae5441c-a7' not found.
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Converting VIF {"id": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "address": "fa:16:3e:fa:3c:ae", "network": {"id": "41d2d479-b262-40e9-b30a-6e6fb253847b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-647571353", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae5441c-a7", "ovs_interfaceid": "4ae5441c-a7a1-4794-aadc-eda58c223eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG os_vif [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae5441c-a7, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:27:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:27:57 user nova-compute[75409]: INFO os_vif [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:3c:ae,bridge_name='br-int',has_traffic_filtering=True,id=4ae5441c-a7a1-4794-aadc-eda58c223eee,network=Network(41d2d479-b262-40e9-b30a-6e6fb253847b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae5441c-a7')
Nov 15 21:27:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [req-b27e32bc-6ca0-4813-8bfd-73509074a788 req-73a8ba33-5cd3-47a4-ab5c-889c09932da2 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:27:57 user nova-compute[75409]:   <nova:package version="0.0.0"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:name>tempest-device-tagging-server-1509117712</nova:name>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:creationTime>2023-11-15 21:27:57</nova:creationTime>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:flavor name="m1.tiny">
Nov 15 21:27:57 user nova-compute[75409]:     <nova:memory>512</nova:memory>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:disk>1</nova:disk>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:swap>0</nova:swap>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:vcpus>1</nova:vcpus>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:flavor>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:user uuid="aa0ba006f108414a9ffdf717199eb4e6">tempest-TaggedAttachmentsTest-1761452003-project-member</nova:user>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:project uuid="7c52c16742b045bbb5416024054f062c">tempest-TaggedAttachmentsTest-1761452003</nova:project>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:owner>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:27:57 user nova-compute[75409]:   <nova:ports>
Nov 15 21:27:57 user nova-compute[75409]:     <nova:port uuid="2c2af0a6-959e-49c1-9e44-5eebe90e5636">
Nov 15 21:27:57 user nova-compute[75409]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:27:57 user nova-compute[75409]:     </nova:port>
Nov 15 21:27:57 user nova-compute[75409]:   </nova:ports>
Nov 15 21:27:57 user nova-compute[75409]: </nova:instance>
Nov 15 21:27:57 user nova-compute[75409]:  {{(pid=75409) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 21:27:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [{"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:27:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Releasing lock "refresh_cache-43bc3403-fc31-4527-8d38-1138e3f7bf8c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:27:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-10035599-d988-448a-996c-360d5ad8649b tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "interface-43bc3403-fc31-4527-8d38-1138e3f7bf8c-4ae5441c-a7a1-4794-aadc-eda58c223eee" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.470s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:27:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:28:03 user nova-compute[75409]: INFO nova.compute.claims [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Claim successful on node user
Nov 15 21:28:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:28:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:28:03 user nova-compute[75409]: INFO nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Booting with volume 6ff48553-b5b5-425e-8929-2a79996842ff at /dev/vda
Nov 15 21:28:03 user nova-compute[75409]: DEBUG nova.policy [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90da430eb1ac4ffbb3e400b7f71c99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c12e41bbcd4659bb3048fa8ed720a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5304e63a-1385-4810-bf95-ef34a0797a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cec2cf-703c-4667-b68d-45b0aec86af9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b14c0a-6b93-4de3-a560-a1982eb5dc76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1f3c1-7ae5-4d93-a73e-fe7be63d8919]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:28:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d7d50f-82d3-4d6b-a5e1-5ba637690fe8]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating existing volume attachment record: ad181528-a27c-472b-a921-325a529f20bb {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully created port: 17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully created port: 1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully created port: d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully created port: b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully created port: c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: 17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-17025d39-395d-4ca8-bb67-c699ebc1057a. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port 17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:07 user nova-compute[75409]: INFO nova.compute.manager [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Detaching volume ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec
Nov 15 21:28:07 user nova-compute[75409]: INFO nova.virt.block_device [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Attempting to driver detach volume ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec from mountpoint /dev/vdb
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Attempting to detach device vdb from instance f3d16138-3e3e-4848-bfcd-d0273f300c86 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:28:07 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:07 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:28:07 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:28:07 user nova-compute[75409]:   <serial>ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec</serial>
Nov 15 21:28:07 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:28:07 user nova-compute[75409]: </disk>
Nov 15 21:28:07 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:28:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully detached device vdb from instance f3d16138-3e3e-4848-bfcd-d0273f300c86 from the persistent domain config.
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3d16138-3e3e-4848-bfcd-d0273f300c86 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:28:07 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:07 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:28:07 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:28:07 user nova-compute[75409]:   <serial>ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec</serial>
Nov 15 21:28:07 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:28:07 user nova-compute[75409]: </disk>
Nov 15 21:28:07 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47969771-e3be-46b5-b7fc-4f3e88a9a800 req-c166fb76-fced-4358-b155-84219a203c4c service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: 6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:08 user nova-compute[75409]: INFO nova.compute.manager [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Terminating instance
Nov 15 21:28:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: INFO nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Booting with volume 3ae221ef-b4ff-4657-b565-3e0af5e824b9 at /dev/vdb
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-6290b0b3-1556-494e-81ef-31fb53e9d63c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port 6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f808b-b33f-4922-8cd5-881682233f03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e43cb0-312a-4144-b19f-27f2b4458420]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0697e-2cfa-4c9f-8286-77efdeafbe96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086f4cc-ef01-47a8-b61f-5f7132ea6b9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: 1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Instance destroyed successfully.
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.objects.instance [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lazy-loading 'resources' on Instance uuid 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:09 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abc58a8-08ae-4c69-9136-bd46abece880]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating existing volume attachment record: 7839de3f-bf9a-437b-96d9-c5081e15ae67 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1423469874',display_name='tempest-VolumesAssistedSnapshotsTest-server-1423469874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1423469874',id=6,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwlj5ORrKaIvMSme1uDlfI+cDglXkQ/DlC7P4c6O91yt5+ktXHmWWBpZ4lAtyK9SCOh2RJPncxFE/63oxtpE+FLiF0I6WfRIl8yuq9UFXvDXj8T845cHLPxl08CqvL6cw==',key_name='tempest-keypair-948153459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ca9b1921524a139d5e1a45a92034b9',ramdisk_id='',reservation_id='r-28np5ixw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1136349916',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1136349916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50fdaf3b48b140e4a35b9311af7fb33f',uuid=6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converting VIF {"id": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "address": "fa:16:3e:9e:80:66", "network": {"id": "124e66f6-90d4-470c-b975-adcfda8b00e5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-978970349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ca9b1921524a139d5e1a45a92034b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd046b4ac-8f", "ovs_interfaceid": "d046b4ac-8f50-4795-b3b4-9336cfc74bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG os_vif [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd046b4ac-8f, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5900c624-2449-4eb5-9454-40802d84dc69) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:09 user nova-compute[75409]: INFO os_vif [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:80:66,bridge_name='br-int',has_traffic_filtering=True,id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1,network=Network(124e66f6-90d4-470c-b975-adcfda8b00e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd046b4ac-8f')
Nov 15 21:28:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Deleting instance files /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2_del
Nov 15 21:28:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Deletion of /opt/stack/data/nova/instances/6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2_del complete
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-fd413390-1be6-4f9c-9f2b-b906f60684e6. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:09 user nova-compute[75409]: INFO nova.compute.manager [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 15 21:28:09 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:28:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-unplugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] No waiting events found dispatching network-vif-unplugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-f8617cb3-07cc-40ea-8501-4168288ed12f req-67fb572c-82aa-45fa-8bcd-d7fb90766ba2 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-unplugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:10 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Took 1.00 seconds to deallocate network for instance.
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-66e39475-cdec-42f7-8f06-a8ca547b806e req-207366c3-6786-4439-b57a-8f23fef5b347 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-deleted-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:10 user nova-compute[75409]: INFO nova.compute.manager [req-66e39475-cdec-42f7-8f06-a8ca547b806e req-207366c3-6786-4439-b57a-8f23fef5b347 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Neutron deleted interface d046b4ac-8f50-4795-b3b4-9336cfc74bf1; detaching it from the instance and deleting it from the info cache
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-66e39475-cdec-42f7-8f06-a8ca547b806e req-207366c3-6786-4439-b57a-8f23fef5b347 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-66e39475-cdec-42f7-8f06-a8ca547b806e req-207366c3-6786-4439-b57a-8f23fef5b347 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Detach interface failed, port_id=d046b4ac-8f50-4795-b3b4-9336cfc74bf1, reason: Instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:11 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Deleted allocations for instance 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-06ea99cc-cde9-465b-a2f2-459c35697c8e tempest-VolumesAssistedSnapshotsTest-1136349916 tempest-VolumesAssistedSnapshotsTest-1136349916-project-member] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.515s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquiring lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Lock "6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] No waiting events found dispatching network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:11 user nova-compute[75409]: WARNING nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 6ff7fcf3-8e98-4ef0-a08a-181a2990e0f2] Received unexpected event network-vif-plugged-d046b4ac-8f50-4795-b3b4-9336cfc74bf1 for instance with vm_state deleted and task_state None.
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-1afa9685-d317-44b6-90d7-8ce4ac3c4836. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port 1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Successfully updated port: c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-d57340c2-9b2d-4191-95c0-7cb6052918db. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-b333783f-0f20-4a55-bb91-82b75e35a4a3. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-68c02448-7c5c-46b9-935f-1a195ae77c11 req-634ace95-0e03-41f3-8186-b4bd019d1469 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:28:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-c66a1a3c-c623-4d53-9790-13b5414254b9. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance network_info: |[{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:14 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b is timed out.
Nov 15 21:28:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully detached device vdc from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the live domain config.
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LitaQsHY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:14 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[338dda0e-ce60-4f9e-8ec3-6c82867d851f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:28:14 user nova-compute[75409]: No targets found.
Nov 15 21:28:14 user nova-compute[75409]: iSNS:
Nov 15 21:28:14 user nova-compute[75409]: No targets found.
Nov 15 21:28:14 user nova-compute[75409]: STATIC:
Nov 15 21:28:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec
Nov 15 21:28:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92
Nov 15 21:28:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:28:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:28:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:14 user nova-compute[75409]: FIRMWARE:
Nov 15 21:28:14 user nova-compute[75409]: No targets found.
Nov 15 21:28:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:28:14 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:28:14 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46e998-c0ba-468b-b9f1-572c88bf6e00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dfafca-cbf2-49fc-9809-555b2d67c603]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 (non-flash)
Nov 15 21:28:14 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281cfb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a519a01-9b95-45a9-9041-bf46ecfd824f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254ce46-12a0-4dfa-9e79-642e8cd79135]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cfe750-6727-4fd3-81c5-cc3ad5e99d60]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[943fda72-2fb3-4a97-8105-8ae735d7a3ae]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d70e80-0328-4ac7-9219-4310e7eb0efc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[773986ac-8563-4e6a-9fde-91351e1dcced]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260]
Nov 15 21:28:14 user nova-compute[75409]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcad9133-549d-4c83-ac76-69b44a6a0a92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc357a4d-0f3c-483b-8d95-ad3f6e81bb9a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== disconnect_volume: return (327ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updated VIF entry in instance network info cache for port c66a1a3c-c623-4d53-9790-13b5414254b9. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b0193c72-3fb5-40ff-8aee-54080cfb9eb4 req-d515c7fa-01f5-4381-b258-350b715e8306 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:14 user nova-compute[75409]: INFO nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Booting with volume 7205a9b1-58f2-4f73-86fb-915cbc6b4974 at /dev/vdc
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cce887-f2f1-4ee0-b585-768c78995230]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997f1aa-4d40-40dc-bc85-4af6e95f436d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39386a-f17b-4145-adcc-dbef0b5e787c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[803dc448-8c9e-47ca-8525-945036f1d180]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:15 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9784f6-e35f-45be-b145-281b1355fab3]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG os_brick.utils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating existing volume attachment record: ad1f2bfb-f309-4338-9776-d3ba36889e9f {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7192c81-cb68-4d58-ba36-5122507fe6d0 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:28:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Creating image(s)
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Ensure instance console log exists: /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Start _get_guest_xml network_info=[{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunJZYcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2768ee6d-1fca-48de-ba3c-23238efcb0eb', 'attached_at': '', 'detached_at': '', 'volume_id': '6ff48553-b5b5-425e-8929-2a79996842ff', 'serial': '6ff48553-b5b5-425e-8929-2a79996842ff'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'ad181528-a27c-472b-a921-325a529f20bb', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHrokdRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2768ee6d-1fca-48de-ba3c-23238efcb0eb', 'attached_at': '', 'detached_at': '', 'volume_id': '3ae221ef-b4ff-4657-b565-3e0af5e824b9', 'serial': '3ae221ef-b4ff-4657-b565-3e0af5e824b9'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '7839de3f-bf9a-437b-96d9-c5081e15ae67', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJGdmIjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2768ee6d-1fca-48de-ba3c-23238efcb0eb', 'attached_at': '', 'detached_at': '', 'volume_id': '7205a9b1-58f2-4f73-86fb-915cbc6b4974', 'serial': '7205a9b1-58f2-4f73-86fb-915cbc6b4974'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'ad1f2bfb-f309-4338-9776-d3ba36889e9f', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:28:20 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:20 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunJZYcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:20 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:20 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:20 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8615b9c1-a0e0-4deb-b5a0-20955753ee1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:28:20 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[578b224f-9b8e-41b1-b210-1de078b5b564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff] added
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c6d56d-64ee-45b9-aee3-64f441c237a0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff50a5b-decd-4ee9-a6d3-d24e8c2124ac]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xunJZYcb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xunJZYcb" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d13360-11a8-4849-b56f-780fde813ab2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xunJZYcb'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9bf6a1-37d7-4c74-b6c9-39316bcb945e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b829832-68c0-4d25-bc44-3c64099eda93]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca05ed73-3402-4d51-b7ca-51e512df6c98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260]
Nov 15 21:28:20 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ffe9b1-ee8b-42f5-9221-a630a9537c45]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccdaa0-354b-42bc-a478-c62d4d08bc06]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:20 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:20 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3c8b4-b8b7-4b9c-8147-e30f429612df]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunJZYcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23461353962306439', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461353962306439', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHrokdRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:21 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:21 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:21 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e816716-1e54-4ca7-8431-f970b2b334b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:28:21 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aab89c-04f4-4cd2-99d4-0e3900adc4ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9] added
Nov 15 21:28:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560c712-5dab-44f8-acff-085b0fea2a75]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d4652-d6d6-423f-a45c-406f285004eb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHrokdRn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:21 user nova-compute[75409]: INFO nova.compute.manager [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Terminating instance
Nov 15 21:28:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHrokdRn" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[808affdd-666f-40ee-863f-7d802206b82b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHrokdRn'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0396a9f3-4cb9-4df4-818b-c3434738ae72]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae5a2a-7133-4d0b-8bd7-f68ce35d8afa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:21 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d04aac-8d3d-43df-b49e-ae4e04c12d97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260]
Nov 15 21:28:22 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9d28e-cbec-4542-a89e-ba68da6fcc41]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fefa830-a258-4e7e-99df-208a5ff70d3a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:22 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:22 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4cd10a-210e-4d90-9c0b-55f2e0f05feb]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHrokdRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-unplugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] No waiting events found dispatching network-vif-unplugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-12d0944f-17ae-4f59-b810-ba557773fcf4 req-72975da5-8c02-44a0-a88c-aede99a46524 service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-unplugged-112a5b2a-327a-43a2-848f-4c2962b305b4 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Instance destroyed successfully.
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lazy-loading 'resources' on Instance uuid 498533a9-85ff-4309-bd4c-c97fb406aad0 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1603878301',display_name='tempest-TestVolumeSwap-server-1603878301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1603878301',id=4,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERB0CZwyoPU6qYfFJy4z64/Hxt1Kq0IA3yNbrp6dY+rXThRtwiSDaGLaAibQd0plluA7ewvNP3LOEE4fcp+78I9FLk1wrVsCVRqUDdqrjqxRTgh6vf7X7yqXhCgI/9csg==',key_name='tempest-keypair-1361528540',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a443c99705304bdea61ec997b4e4b2a9',ramdisk_id='',reservation_id='r-cgpx4fks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-991569155',owner_user_name='tempest-TestVolumeSwap-991569155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd6a355fb5c64dc183bd8160e4a6c069',uuid=498533a9-85ff-4309-bd4c-c97fb406aad0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converting VIF {"id": "112a5b2a-327a-43a2-848f-4c2962b305b4", "address": "fa:16:3e:0e:ab:2c", "network": {"id": "f6642ccc-5804-4f45-ae77-f4c1d421c80c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1450800248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a443c99705304bdea61ec997b4e4b2a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112a5b2a-32", "ovs_interfaceid": "112a5b2a-327a-43a2-848f-4c2962b305b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG os_vif [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112a5b2a-32, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b37f308-0960-402a-9333-73762afabcef) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:22 user nova-compute[75409]: INFO os_vif [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ab:2c,bridge_name='br-int',has_traffic_filtering=True,id=112a5b2a-327a-43a2-848f-4c2962b305b4,network=Network(f6642ccc-5804-4f45-ae77-f4c1d421c80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112a5b2a-32')
Nov 15 21:28:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Deleting instance files /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0_del
Nov 15 21:28:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Deletion of /opt/stack/data/nova/instances/498533a9-85ff-4309-bd4c-c97fb406aad0_del complete
Nov 15 21:28:22 user nova-compute[75409]: INFO nova.compute.manager [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 21:28:22 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:28:22 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23866653739356166', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866653739356166', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJGdmIjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:23 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b9aa0-ecee-48eb-87e0-076a54ca1ca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:28:23 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73cb785-ae8f-4eb3-a698-b2f3a364b863]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974] added
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2525ec-eff5-441a-8f21-95595e7c5d26]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece91587-d838-47db-bee3-e4339ea28e98]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJGdmIjZ {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJGdmIjZ" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a7cd47-e7c4-4241-8b51-ffa8480487bf]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PJGdmIjZ'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c9e2b-5965-4d38-bef6-c9b34b344cd7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77cd84-ac85-4135-923d-1dd7e61d709a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcde9a5-613b-4e3a-858a-42e9a438e17a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260]
Nov 15 21:28:23 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa2592-63b0-4bff-87d4-1b5a4c9fe0db]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:23 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Took 0.68 seconds to deallocate network for instance.
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-88430c22-59f9-4645-aab6-551edfeb842d req-5e7671fa-7016-4138-a608-23f3d6c5b78e service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-deleted-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:23 user nova-compute[75409]: INFO nova.compute.manager [req-88430c22-59f9-4645-aab6-551edfeb842d req-5e7671fa-7016-4138-a608-23f3d6c5b78e service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Neutron deleted interface 112a5b2a-327a-43a2-848f-4c2962b305b4; detaching it from the instance and deleting it from the info cache
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.network.neutron [req-88430c22-59f9-4645-aab6-551edfeb842d req-5e7671fa-7016-4138-a608-23f3d6c5b78e service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc22c37-4d53-4270-b624-88249f15c88d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-88430c22-59f9-4645-aab6-551edfeb842d req-5e7671fa-7016-4138-a608-23f3d6c5b78e service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Detach interface failed, port_id=112a5b2a-327a-43a2-848f-4c2962b305b4, reason: Instance 498533a9-85ff-4309-bd4c-c97fb406aad0 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c520717f-fca2-4c07-8122-a27a711976c5]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJGdmIjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:23 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Deleted allocations for instance 498533a9-85ff-4309-bd4c-c97fb406aad0
Nov 15 21:28:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1806ff6d-139f-48fd-b52f-dd253a629e6c tempest-TestVolumeSwap-991569155 tempest-TestVolumeSwap-991569155-project-member] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] Acquiring lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] Lock "498533a9-85ff-4309-bd4c-c97fb406aad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.compute.manager [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] No waiting events found dispatching network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:24 user nova-compute[75409]: WARNING nova.compute.manager [req-586ed174-1ab6-4d29-9ab5-726c9fe0cace req-256e44e2-bd2b-48c4-a1e1-aa7eeadf0dfd service nova] [instance: 498533a9-85ff-4309-bd4c-c97fb406aad0] Received unexpected event network-vif-plugged-112a5b2a-327a-43a2-848f-4c2962b305b4 for instance with vm_state deleted and task_state None.
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23039306464353032', 'path': '/dev/sdg'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039306464353032', 'path': '/dev/sdg'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.objects.instance [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lazy-loading 'pci_devices' on Instance uuid 2768ee6d-1fca-48de-ba3c-23238efcb0eb {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:28:24 user nova-compute[75409]:   <uuid>2768ee6d-1fca-48de-ba3c-23238efcb0eb</uuid>
Nov 15 21:28:24 user nova-compute[75409]:   <name>instance-0000000d</name>
Nov 15 21:28:24 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:28:24 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:28:24 user nova-compute[75409]:   <metadata>
Nov 15 21:28:24 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:28:24 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:name>tempest-device-tagging-server-558204565</nova:name>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:28:20</nova:creationTime>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:28:24 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:28:24 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:owner>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:user uuid="90da430eb1ac4ffbb3e400b7f71c99a1">tempest-TaggedBootDevicesTest-1476863537-project-member</nova:user>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:project uuid="d8c12e41bbcd4659bb3048fa8ed720a2">tempest-TaggedBootDevicesTest-1476863537</nova:project>
Nov 15 21:28:24 user nova-compute[75409]:       </nova:owner>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:28:24 user nova-compute[75409]:       <nova:ports>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="17025d39-395d-4ca8-bb67-c699ebc1057a">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="6290b0b3-1556-494e-81ef-31fb53e9d63c">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="fd413390-1be6-4f9c-9f2b-b906f60684e6">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="1afa9685-d317-44b6-90d7-8ce4ac3c4836">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="d57340c2-9b2d-4191-95c0-7cb6052918db">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="b333783f-0f20-4a55-bb91-82b75e35a4a3">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:         <nova:port uuid="c66a1a3c-c623-4d53-9790-13b5414254b9">
Nov 15 21:28:24 user nova-compute[75409]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 21:28:24 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:24 user nova-compute[75409]:       </nova:ports>
Nov 15 21:28:24 user nova-compute[75409]:     </nova:instance>
Nov 15 21:28:24 user nova-compute[75409]:   </metadata>
Nov 15 21:28:24 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:28:24 user nova-compute[75409]:     <system>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="serial">2768ee6d-1fca-48de-ba3c-23238efcb0eb</entry>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="uuid">2768ee6d-1fca-48de-ba3c-23238efcb0eb</entry>
Nov 15 21:28:24 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:28:24 user nova-compute[75409]:     </system>
Nov 15 21:28:24 user nova-compute[75409]:   </sysinfo>
Nov 15 21:28:24 user nova-compute[75409]:   <os>
Nov 15 21:28:24 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:28:24 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:28:24 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:28:24 user nova-compute[75409]:   </os>
Nov 15 21:28:24 user nova-compute[75409]:   <features>
Nov 15 21:28:24 user nova-compute[75409]:     <acpi/>
Nov 15 21:28:24 user nova-compute[75409]:     <apic/>
Nov 15 21:28:24 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:28:24 user nova-compute[75409]:   </features>
Nov 15 21:28:24 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:28:24 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:28:24 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:28:24 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:28:24 user nova-compute[75409]:   </clock>
Nov 15 21:28:24 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:28:24 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:28:24 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:28:24 user nova-compute[75409]:   </cpu>
Nov 15 21:28:24 user nova-compute[75409]:   <devices>
Nov 15 21:28:24 user nova-compute[75409]:     <disk type="file" device="cdrom">
Nov 15 21:28:24 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 21:28:24 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/disk.config"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="hda" bus="ide"/>
Nov 15 21:28:24 user nova-compute[75409]:     </disk>
Nov 15 21:28:24 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:28:24 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:24 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <serial>6ff48553-b5b5-425e-8929-2a79996842ff</serial>
Nov 15 21:28:24 user nova-compute[75409]:     </disk>
Nov 15 21:28:24 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:28:24 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:24 user nova-compute[75409]:       <source dev="/dev/sdd"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <serial>3ae221ef-b4ff-4657-b565-3e0af5e824b9</serial>
Nov 15 21:28:24 user nova-compute[75409]:     </disk>
Nov 15 21:28:24 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:28:24 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:24 user nova-compute[75409]:       <source dev="/dev/sdg"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="vdc" bus="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <serial>7205a9b1-58f2-4f73-86fb-915cbc6b4974</serial>
Nov 15 21:28:24 user nova-compute[75409]:     </disk>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:0c:ad:1d"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tap17025d39-39"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:95:11:29"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tap6290b0b3-15"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:ad:40:0a"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tapfd413390-1b"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:d7:56:9f"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tap1afa9685-d3"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:67:9b:5d"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tapd57340c2-9b"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:62:0e:2d"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tapb333783f-0f"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:24 user nova-compute[75409]:       <mac address="fa:16:3e:ce:75:1e"/>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:24 user nova-compute[75409]:       <target dev="tapc66a1a3c-c6"/>
Nov 15 21:28:24 user nova-compute[75409]:     </interface>
Nov 15 21:28:24 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:28:24 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/console.log" append="off"/>
Nov 15 21:28:24 user nova-compute[75409]:     </serial>
Nov 15 21:28:24 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:28:24 user nova-compute[75409]:     <video>
Nov 15 21:28:24 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:24 user nova-compute[75409]:     </video>
Nov 15 21:28:24 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:28:24 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:28:24 user nova-compute[75409]:     </rng>
Nov 15 21:28:24 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:28:24 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:28:24 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:28:24 user nova-compute[75409]:     </memballoon>
Nov 15 21:28:24 user nova-compute[75409]:   </devices>
Nov 15 21:28:24 user nova-compute[75409]: </domain>
Nov 15 21:28:24 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60c243af-334a-589b-858f-02b5f8238fbb', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17025d39-39, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17025d39-39, col_values=(('qos', UUID('655d9568-d9e9-4196-bfc6-0c5d96ded277')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17025d39-39, col_values=(('external_ids', {'iface-id': '17025d39-395d-4ca8-bb67-c699ebc1057a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:ad:1d', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39')
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56595a88-1020-5657-a475-3936d7884a59', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6290b0b3-15, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6290b0b3-15, col_values=(('qos', UUID('71bdffb7-65b0-4fd7-9ec6-ae1d98375d10')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6290b0b3-15, col_values=(('external_ids', {'iface-id': '6290b0b3-1556-494e-81ef-31fb53e9d63c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:11:29', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15')
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f679f0a1-14c6-5c91-ac6d-18b4bd1ba908', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd413390-1b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd413390-1b, col_values=(('qos', UUID('0596b330-39eb-4ff5-9a0e-b5e059160d6c')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd413390-1b, col_values=(('external_ids', {'iface-id': 'fd413390-1be6-4f9c-9f2b-b906f60684e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:40:0a', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b')
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcc4c854-9422-53c2-bcfa-c29c66accd0e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1afa9685-d3, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1afa9685-d3, col_values=(('qos', UUID('014857f8-0d3b-4228-89d9-6fcd267f25d6')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1afa9685-d3, col_values=(('external_ids', {'iface-id': '1afa9685-d317-44b6-90d7-8ce4ac3c4836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:56:9f', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3')
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9c280e6-c287-5ecf-86b8-977d6efaaa47', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd57340c2-9b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd57340c2-9b, col_values=(('qos', UUID('7184cfc3-1030-4d9f-91e2-7dbe6496629b')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd57340c2-9b, col_values=(('external_ids', {'iface-id': 'd57340c2-9b2d-4191-95c0-7cb6052918db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:9b:5d', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b')
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61b4f51d-c2c4-572c-8f4b-c25305cf8b0c', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb333783f-0f, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb333783f-0f, col_values=(('qos', UUID('ccf2fd75-1ad2-4579-bddf-5e6155266e38')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb333783f-0f, col_values=(('external_ids', {'iface-id': 'b333783f-0f20-4a55-bb91-82b75e35a4a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:0e:2d', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f')
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5eb3fa3-8aa5-5186-a9b2-e5665d170ba4', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66a1a3c-c6, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66a1a3c-c6, col_values=(('qos', UUID('eba975e0-8bdf-4124-af75-ddbc9a39dab3')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66a1a3c-c6, col_values=(('external_ids', {'iface-id': 'c66a1a3c-c623-4d53-9790-13b5414254b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:75:1e', 'vm-uuid': '2768ee6d-1fca-48de-ba3c-23238efcb0eb'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:25 user nova-compute[75409]: INFO os_vif [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6')
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] No BDM found with device name hda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] No VIF found with MAC fa:16:3e:0c:ad:1d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] No VIF found with MAC fa:16:3e:67:9b:5d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:25 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Using config drive
Nov 15 21:28:25 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Creating config drive at /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/disk.config
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbp3zz3ho {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:25 user nova-compute[75409]: INFO nova.compute.manager [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Unshelving
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbp3zz3ho" returned: 0 in 0.051s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:25 user nova-compute[75409]: INFO nova.virt.block_device [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Booting with volume cc061491-adc2-4e48-80db-c8fb4cfb4e32 at /dev/vdc
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.utils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14593a-9e72-4456-b665-04c2987fa299]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4744057-f8fa-4362-8ce3-b9e19d285a61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec5f827-8895-4d80-9cae-cd377ebc1243]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78d9c63-d6d4-42e4-8ddb-192be7994cc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:25 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:28:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57617fa-c990-41c7-9a61-3b60e97d771c]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG os_brick.utils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:25 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating existing volume attachment record: d041dcb1-a978-486b-b454-b85ff67b5f9f {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:28:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:27 user nova-compute[75409]: WARNING nova.compute.manager [req-93c273b1-5fd7-4500-bfee-c3bc75413145 req-45c6b77f-2ced-48e2-bdd6-54a6c11734c7 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a for instance with vm_state building and task_state spawning.
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:27 user nova-compute[75409]: WARNING nova.compute.manager [req-8581101f-fa66-403b-b67b-429cf33ed9cf req-176934a7-a268-4e4f-9e68-76b0a959ff0e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c for instance with vm_state building and task_state spawning.
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:27 user nova-compute[75409]: INFO nova.compute.manager [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Terminating instance
Nov 15 21:28:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3d16138-3e3e-4848-bfcd-d0273f300c86 is timed out.
Nov 15 21:28:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully detached device vdb from instance f3d16138-3e3e-4848-bfcd-d0273f300c86 from the live domain config.
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsCtRWEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:28 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f07eb-7aca-4b56-a153-e87a7152069b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:28:28 user nova-compute[75409]: No targets found.
Nov 15 21:28:28 user nova-compute[75409]: iSNS:
Nov 15 21:28:28 user nova-compute[75409]: No targets found.
Nov 15 21:28:28 user nova-compute[75409]: STATIC:
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:28:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:28 user nova-compute[75409]: FIRMWARE:
Nov 15 21:28:28 user nova-compute[75409]: No targets found.
Nov 15 21:28:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:28:28 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:28:28 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f70b7-655b-40d3-b396-080025bd4f38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:28 user nova-compute[75409]: WARNING nova.compute.manager [req-4769614a-5bec-4fd2-9fac-b84e38e1eda3 req-c6b686c5-e3cd-4411-822d-2cafd3b60274 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 for instance with vm_state building and task_state spawning.
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9c698c-9a40-4d45-846d-449fd1182e61]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281bbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'flavor' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc6a3c3-e7c8-4276-b0ab-a8d1b6eda76f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be53251d-4cd8-4eb6-bfaf-31b7e997399e]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4568ed-c49d-411e-a1a5-9df44e46671a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2066527-d828-429d-b888-314793905bed]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c80861-7006-4adf-a9f8-f237a0bc93bc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a60b93d-48b3-4354-ae48-4b153ca40710]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260]
Nov 15 21:28:28 user nova-compute[75409]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:28 user nova-compute[75409]: INFO nova.compute.manager [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attaching volume f0db07f5-a51b-48cf-9842-0c6f1cd573e0 to /dev/vdb
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1107e7-ae6c-4179-808a-2b183d5d9746]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== disconnect_volume: return (442ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.utils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf132dc-b085-4a55-8a25-055804b74405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908508f-2c48-4c4a-95a5-6a2935e4c810]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f57671-734d-438b-8012-341c8db44e45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01794b2-37d8-4db7-af97-e1c7b929023c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:28:28 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:28:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c64354-c203-4198-8ad0-c7695c996aa5]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG os_brick.utils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating existing volume attachment record: 9ccdaa6a-66b1-429b-8853-988fc987c202 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Instance destroyed successfully.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.objects.instance [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lazy-loading 'resources' on Instance uuid 43bc3403-fc31-4527-8d38-1138e3f7bf8c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1509117712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1509117712',id=5,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHJfaaPwDVGTDWXM6Sg/GKLko/Z31wum/SLaU/mLYtKxtSIU1z0J6RhARqqfXIClvsdzQRmjrdlsoYUUVUP3HTSrQJ3QmZnQWO0/DlySvh/jaGuZQnV+PlQeIJKM31qoA==',key_name='tempest-keypair-784874723',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c52c16742b045bbb5416024054f062c',ramdisk_id='',reservation_id='r-wcyrzdty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1761452003',owner_user_name='tempest-TaggedAttachmentsTest-1761452003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa0ba006f108414a9ffdf717199eb4e6',uuid=43bc3403-fc31-4527-8d38-1138e3f7bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converting VIF {"id": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "address": "fa:16:3e:a1:21:08", "network": {"id": "216bc928-8615-4130-ba60-1cc7df3c7626", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1745084447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c52c16742b045bbb5416024054f062c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2af0a6-95", "ovs_interfaceid": "2c2af0a6-959e-49c1-9e44-5eebe90e5636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG os_vif [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2af0a6-95, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5eb72ec-fc4c-4090-ad57-6816d17ec3be) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: INFO os_vif [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:21:08,bridge_name='br-int',has_traffic_filtering=True,id=2c2af0a6-959e-49c1-9e44-5eebe90e5636,network=Network(216bc928-8615-4130-ba60-1cc7df3c7626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2af0a6-95')
Nov 15 21:28:29 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Deleting instance files /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c_del
Nov 15 21:28:29 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Deletion of /opt/stack/data/nova/instances/43bc3403-fc31-4527-8d38-1138e3f7bf8c_del complete
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:29 user nova-compute[75409]: WARNING nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a for instance with vm_state building and task_state spawning.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:29 user nova-compute[75409]: WARNING nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 for instance with vm_state building and task_state spawning.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:29 user nova-compute[75409]: WARNING nova.compute.manager [req-a1b0f497-e6a9-417c-a33a-b9f6fa965944 req-b238b11e-66dc-407d-a259-79c18a4b839b service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 for instance with vm_state building and task_state spawning.
Nov 15 21:28:29 user nova-compute[75409]: INFO nova.compute.manager [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.objects.instance [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-20ad5cf7-f8ea-4aa0-aec5-efe53803e053 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.065s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.887s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: INFO nova.compute.manager [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Terminating instance
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:29 user nova-compute[75409]: WARNING nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c for instance with vm_state building and task_state spawning.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:29 user nova-compute[75409]: WARNING nova.compute.manager [req-2a483cb3-4609-4bde-b206-8812a39f2a26 req-99743dd7-df17-4ca0-91ec-43b3b65e37a5 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 for instance with vm_state building and task_state spawning.
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:30 user nova-compute[75409]: WARNING nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 for instance with vm_state building and task_state spawning.
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-unplugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-unplugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-unplugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Acquiring lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] No waiting events found dispatching network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:30 user nova-compute[75409]: WARNING nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received unexpected event network-vif-plugged-2c2af0a6-959e-49c1-9e44-5eebe90e5636 for instance with vm_state active and task_state deleting.
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:30 user nova-compute[75409]: WARNING nova.compute.manager [req-ac579ab8-204c-4c51-ace9-8818bc2f27b2 req-9ebd9ba6-277d-443e-b31f-f680477d011e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db for instance with vm_state building and task_state spawning.
Nov 15 21:28:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Instance destroyed successfully.
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.objects.instance [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'resources' on Instance uuid f3d16138-3e3e-4848-bfcd-d0273f300c86 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2116039095',display_name='tempest-VolumesSnapshotTestJSON-instance-2116039095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2116039095',id=11,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3lTzizryWlzCdn9FSoOlR4KArK4o6ryEJKeCReMIGKjDUVRM8+fKOd6jvV5XFFWq8ze+S7iYMe3EDljzUk02hsPQg3XbHRV8mcJor9h93MDbJaY6uKUkG+IbJ8CJdmYg==',key_name='tempest-keypair-1112517365',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-o5h7idug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:26:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=f3d16138-3e3e-4848-bfcd-d0273f300c86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "d37ff7cb-9750-44bc-976c-309de6f3d691", "address": "fa:16:3e:87:18:1c", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd37ff7cb-97", "ovs_interfaceid": "d37ff7cb-9750-44bc-976c-309de6f3d691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_vif [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd37ff7cb-97, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cfd2c66-ff9f-4595-a10b-e64e7d0a8d17) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:30 user nova-compute[75409]: INFO os_vif [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:18:1c,bridge_name='br-int',has_traffic_filtering=True,id=d37ff7cb-9750-44bc-976c-309de6f3d691,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd37ff7cb-97')
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsCtRWEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:30 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6cea3-5685-4b9a-98ed-8b5ee86acb66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:28:30 user nova-compute[75409]: No targets found.
Nov 15 21:28:30 user nova-compute[75409]: iSNS:
Nov 15 21:28:30 user nova-compute[75409]: No targets found.
Nov 15 21:28:30 user nova-compute[75409]: STATIC:
Nov 15 21:28:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:28:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff
Nov 15 21:28:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:28:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:28:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:28:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:28:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:28:30 user nova-compute[75409]: FIRMWARE:
Nov 15 21:28:30 user nova-compute[75409]: No targets found.
Nov 15 21:28:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:28:30 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:28:30 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccfdfb2c-88f7-45ea-8df2-56fb1fecb4ec', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f742bf-b49d-45dd-94fa-4b73d2a8a803]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a5605-06d4-4be6-9d5f-ba77690aaef6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf086fcd30>, {}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Disconnecting from: [] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.121s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== disconnect_volume: return (123ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:28:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Deleting instance files /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86_del
Nov 15 21:28:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Deletion of /opt/stack/data/nova/instances/f3d16138-3e3e-4848-bfcd-d0273f300c86_del complete
Nov 15 21:28:30 user nova-compute[75409]: INFO nova.compute.manager [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 21:28:30 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:28:30 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:30 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Took 1.70 seconds to deallocate network for instance.
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-unplugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] No waiting events found dispatching network-vif-unplugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-unplugged-d37ff7cb-9750-44bc-976c-309de6f3d691 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Acquiring lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] No waiting events found dispatching network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:31 user nova-compute[75409]: WARNING nova.compute.manager [req-fb0bf354-bd42-4a2e-9ce4-6445680932fb req-c3888823-0b1f-4d28-9455-6ed33e7dc4a7 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received unexpected event network-vif-plugged-d37ff7cb-9750-44bc-976c-309de6f3d691 for instance with vm_state active and task_state deleting.
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:31 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Deleted allocations for instance 43bc3403-fc31-4527-8d38-1138e3f7bf8c
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:32 user nova-compute[75409]: WARNING nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 for instance with vm_state building and task_state spawning.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:32 user nova-compute[75409]: WARNING nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 for instance with vm_state building and task_state spawning.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 43bc3403-fc31-4527-8d38-1138e3f7bf8c] Received event network-vif-deleted-2c2af0a6-959e-49c1-9e44-5eebe90e5636 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:32 user nova-compute[75409]: WARNING nova.compute.manager [req-b844ef22-d6e6-4f14-9801-adf22c64acad req-1f2932c6-cf0c-447c-b9e6-30078c845c61 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 for instance with vm_state building and task_state spawning.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-091d6a42-458e-43d3-9d77-b4c2596a5e63 tempest-TaggedAttachmentsTest-1761452003 tempest-TaggedAttachmentsTest-1761452003-project-member] Lock "43bc3403-fc31-4527-8d38-1138e3f7bf8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.456s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:32 user nova-compute[75409]: WARNING nova.compute.manager [req-7f2551d1-0081-4699-869b-6dbf1b0a85b8 req-4abfca45-5b12-4161-a1d0-d74402f5c91f service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db for instance with vm_state building and task_state spawning.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:32 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Took 1.79 seconds to deallocate network for instance.
Nov 15 21:28:32 user nova-compute[75409]: WARNING nova.volume.cinder [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Attachment 993c42a5-12a9-4df7-93d2-ea65e51de205 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 993c42a5-12a9-4df7-93d2-ea65e51de205. (HTTP 404) (Request-ID: req-0598a1f7-70c0-4e28-83ec-ec51f4e49d59)
Nov 15 21:28:32 user nova-compute[75409]: INFO nova.compute.manager [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:28:32 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance spawned successfully.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:32 user nova-compute[75409]: INFO nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Took 12.61 seconds to spawn the instance on the hypervisor.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.148s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:32 user nova-compute[75409]: INFO nova.compute.manager [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Took 29.78 seconds to build instance.
Nov 15 21:28:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_requests' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:33 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Deleted allocations for instance f3d16138-3e3e-4848-bfcd-d0273f300c86
Nov 15 21:28:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-63561f15-97b1-461f-b3de-56593db8ffe5 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.878s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'numa_topology' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:28:33 user nova-compute[75409]: INFO nova.compute.claims [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Claim successful on node user
Nov 15 21:28:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-45d9e147-0fec-406f-af87-312ad9a1cad5 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "f3d16138-3e3e-4848-bfcd-d0273f300c86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.571s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:33 user nova-compute[75409]: INFO nova.network.neutron [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating port d098b838-c6bc-49e1-9021-293a1b527c93 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: f3d16138-3e3e-4848-bfcd-d0273f300c86] Received event network-vif-deleted-d37ff7cb-9750-44bc-976c-309de6f3d691 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing instance network info cache due to event network-changed-d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] Acquiring lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:28:34 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Creating image(s)
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] Acquired lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Refreshing network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.objects.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77ef017e-9905-491a-9def-b81e289ac07b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:34 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:34 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:34 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b110e23-1746-4737-a22c-eb52c6805709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:28:34 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c29d53-cf08-47e9-83cc-ebcec02d5fdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0] added
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a08bf-548f-4518-afee-4fc454755f9d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3d25f-108e-45b0-8fee-ac8add745da3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twFzeSDy {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twFzeSDy" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5b84a-9cbe-4072-8407-1cde7addd149]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'twFzeSDy'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca2eed4-ff24-40a9-aec1-aa93c9e29bf0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[250750b8-9a1f-476f-81da-0500a6d111fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG nova.virt.images [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] 0bc8c3c4-0b8a-4d58-a899-ca83c86d171a was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.part /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3c80d-0741-41fd-bfc7-098bb10c9dc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260]
Nov 15 21:28:36 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed40f0-f2ad-497e-855c-208c09f81797]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59faba23-baf4-4ed6-a288-cabf125f8b05]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.475s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096cce5-844e-47f2-b4f0-890c5fbc1089]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updated VIF entry in instance network info cache for port d098b838-c6bc-49e1-9021-293a1b527c93. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4cfd3306-186a-41b4-a1a4-2f055f3b482e req-e68af6a7-7257-48ae-9a99-745b4031fdf3 service nova] Releasing lock "refresh_cache-77ef017e-9905-491a-9def-b81e289ac07b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.part /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.converted" returned: 0 in 0.506s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.146s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json" returned: 0 in 0.313s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.528s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] <== connect_volume: return (2531ms) {'type': 'block', 'scsi_wwn': '23936623437316238', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936623437316238', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'flavor' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696,backing_fmt=raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:28:37 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:37 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:28:37 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:28:37 user nova-compute[75409]:   <serial>f0db07f5-a51b-48cf-9842-0c6f1cd573e0</serial>
Nov 15 21:28:37 user nova-compute[75409]: </disk>
Nov 15 21:28:37 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696,backing_fmt=raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "07a1e41686f7363ac52c7c4f8b8fde797d319696" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 --force-share --output=json" returned: 0 in 0.251s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'migration_context' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:37 user nova-compute[75409]: DEBUG nova.objects.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77ef017e-9905-491a-9def-b81e289ac07b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:37 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Rebasing disk image.
Nov 15 21:28:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.239s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 -F raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No VIF found with MAC fa:16:3e:82:40:c6, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5cfec00-2f71-4aec-9436-b13543962e66 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.836s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:28:39 user nova-compute[75409]: INFO nova.compute.manager [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Rescuing
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 -F raw /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk" returned: 0 in 2.741s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Ensure instance console log exists: /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start _get_guest_xml network_info=[{"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5c25057722da3fde198107b60333f40c',container_format='bare',created_at=2023-11-15T21:26:33Z,direct_url=<?>,disk_format='qcow2',id=0bc8c3c4-0b8a-4d58-a899-ca83c86d171a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1521868239-shelved',owner='46dfeeef89eb4141be700d34d6d0f1ea',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T21:26:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsWCuVOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '77ef017e-9905-491a-9def-b81e289ac07b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc061491-adc2-4e48-80db-c8fb4cfb4e32', 'serial': 'cc061491-adc2-4e48-80db-c8fb4cfb4e32'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'd041dcb1-a978-486b-b454-b85ff67b5f9f', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:28:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:40 user nova-compute[75409]: WARNING nova.compute.manager [req-9efe7f76-4b56-473f-89c7-7d275b26ed66 req-9680f2a2-7b60-495a-b3e0-6acd62954395 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state rescuing.
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c25057722da3fde198107b60333f40c',container_format='bare',created_at=2023-11-15T21:26:33Z,direct_url=<?>,disk_format='qcow2',id=0bc8c3c4-0b8a-4d58-a899-ca83c86d171a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1521868239-shelved',owner='46dfeeef89eb4141be700d34d6d0f1ea',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T21:26:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.objects.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77ef017e-9905-491a-9def-b81e289ac07b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsWCuVOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:40 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:40 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:40 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49fb9f-6877-40e9-9de0-602d7daa4932]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:28:40 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bcdcb9-cd5b-401e-9f7d-c3ed6ef7b5ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32] added
Nov 15 21:28:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance destroyed successfully.
Nov 15 21:28:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8330MB free_disk=25.319183349609375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:41 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attempting a stable device rescue
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3f366-0906-4d77-87d1-29b2cbe43b34]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd4e937-84d4-4666-b2d7-7d1b90d40a68]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsWCuVOf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsWCuVOf" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cff59a-8685-4cd7-987a-10b9710211ff]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsWCuVOf'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:28:41 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Creating image(s)
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "4ef3e963213803d473a49c608fce2d15b6760cf5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "4ef3e963213803d473a49c608fce2d15b6760cf5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64922ae-2aaf-425f-b7f0-dcd5c7933d6f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance bac6908e-d641-439c-bb4c-8a86352bb9d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 0208271e-c742-4fb4-8ae8-1fe9907d677b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 2768ee6d-1fca-48de-ba3c-23238efcb0eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (6d992785-dcac-407e-b10c-2f8c1f949a7e): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb2dd7-beb2-4990-9876-0adaed670c02]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91654878-bc33-414f-9856-7ea617db05d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260]
Nov 15 21:28:41 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260] successful.
Nov 15 21:28:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec43d5-73ad-40e2-a497-d0291098b4c7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:43 user nova-compute[75409]: WARNING nova.compute.manager [req-1cecf8f5-c611-4d76-9584-68f99f0e29a5 req-04515ade-44f1-4a2b-990b-0779a11c37c7 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state rescuing.
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cdd77c-8d23-46fe-aadb-cda92d9794ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:28:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.285s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c3d0a-ec97-4753-8f86-c3900f848713]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.virt.images [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] 29c40e69-8b1c-4aff-8be6-d6266e068363 was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.part /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.699s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.part /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.converted" returned: 0 in 0.312s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "4ef3e963213803d473a49c608fce2d15b6760cf5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.095s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "4ef3e963213803d473a49c608fce2d15b6760cf5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "4ef3e963213803d473a49c608fce2d15b6760cf5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.compute.claims [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Claim successful on node user
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5 --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5,backing_fmt=raw /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5,backing_fmt=raw /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue" returned: 0 in 0.064s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "4ef3e963213803d473a49c608fce2d15b6760cf5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'migration_context' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Object Instance<c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start _get_guest_xml network_info=[{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "vif_mac": "fa:16:3e:82:40:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '29c40e69-8b1c-4aff-8be6-d6266e068363', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'serial': 'f0db07f5-a51b-48cf-9842-0c6f1cd573e0'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '9ccdaa6a-66b1-429b-8853-988fc987c202', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'resources' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.compute.manager [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Detaching volume 69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Object Instance<c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'numa_topology' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Object Instance<c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsWCuVOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.324s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] <== connect_volume: return (3326ms) {'type': 'block', 'scsi_wwn': '23938383835626136', 'path': '/dev/sdh'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938383835626136', 'path': '/dev/sdh'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:44 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:44 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.virt.block_device [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Attempting to driver detach volume 69edd15b-f331-479a-81cc-c00fadaac969 from mountpoint /dev/vdb
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='0bc8c3c4-0b8a-4d58-a899-ca83c86d171a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-289692261',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:26:38.257628',shelved_host='user',shelved_image_id='0bc8c3c4-0b8a-4d58-a899-ca83c86d171a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_devices' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Object Instance<c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:28:44 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:44 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:28:44 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77ef017e-9905-491a-9def-b81e289ac07b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:28:44 user nova-compute[75409]:   <uuid>77ef017e-9905-491a-9def-b81e289ac07b</uuid>
Nov 15 21:28:44 user nova-compute[75409]:   <name>instance-00000002</name>
Nov 15 21:28:44 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:28:44 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:28:44 user nova-compute[75409]:   <metadata>
Nov 15 21:28:44 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:28:44 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1521868239</nova:name>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:28:40</nova:creationTime>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:28:44 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:owner>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:user uuid="ceded6a59a6842e792ad3aced2b85da9">tempest-AttachVolumeShelveTestJSON-1237497947-project-member</nova:user>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:project uuid="46dfeeef89eb4141be700d34d6d0f1ea">tempest-AttachVolumeShelveTestJSON-1237497947</nova:project>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:owner>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:root type="image" uuid="0bc8c3c4-0b8a-4d58-a899-ca83c86d171a"/>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:ports>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:port uuid="d098b838-c6bc-49e1-9021-293a1b527c93">
Nov 15 21:28:44 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 21:28:44 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:ports>
Nov 15 21:28:44 user nova-compute[75409]:     </nova:instance>
Nov 15 21:28:44 user nova-compute[75409]:   </metadata>
Nov 15 21:28:44 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:28:44 user nova-compute[75409]:     <system>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="serial">77ef017e-9905-491a-9def-b81e289ac07b</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="uuid">77ef017e-9905-491a-9def-b81e289ac07b</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:28:44 user nova-compute[75409]:     </system>
Nov 15 21:28:44 user nova-compute[75409]:   </sysinfo>
Nov 15 21:28:44 user nova-compute[75409]:   <os>
Nov 15 21:28:44 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:28:44 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:28:44 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:28:44 user nova-compute[75409]:   </os>
Nov 15 21:28:44 user nova-compute[75409]:   <features>
Nov 15 21:28:44 user nova-compute[75409]:     <acpi/>
Nov 15 21:28:44 user nova-compute[75409]:     <apic/>
Nov 15 21:28:44 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:28:44 user nova-compute[75409]:   </features>
Nov 15 21:28:44 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:28:44 user nova-compute[75409]:   </clock>
Nov 15 21:28:44 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:28:44 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:28:44 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:28:44 user nova-compute[75409]:   </cpu>
Nov 15 21:28:44 user nova-compute[75409]:   <devices>
Nov 15 21:28:44 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:28:44 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:     </disk>
Nov 15 21:28:44 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:44 user nova-compute[75409]:       <source dev="/dev/sdh"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="vdc" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:       <serial>cc061491-adc2-4e48-80db-c8fb4cfb4e32</serial>
Nov 15 21:28:44 user nova-compute[75409]:     </disk>
Nov 15 21:28:44 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:44 user nova-compute[75409]:       <mac address="fa:16:3e:c5:59:0d"/>
Nov 15 21:28:44 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="tapd098b838-c6"/>
Nov 15 21:28:44 user nova-compute[75409]:     </interface>
Nov 15 21:28:44 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:28:44 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/console.log" append="off"/>
Nov 15 21:28:44 user nova-compute[75409]:     </serial>
Nov 15 21:28:44 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:28:44 user nova-compute[75409]:     <video>
Nov 15 21:28:44 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:     </video>
Nov 15 21:28:44 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:28:44 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:28:44 user nova-compute[75409]:     </rng>
Nov 15 21:28:44 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:28:44 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:28:44 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:28:44 user nova-compute[75409]:     </memballoon>
Nov 15 21:28:44 user nova-compute[75409]:   </devices>
Nov 15 21:28:44 user nova-compute[75409]: </domain>
Nov 15 21:28:44 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='0bc8c3c4-0b8a-4d58-a899-ca83c86d171a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-289692261',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:26:38.257628',shelved_host='user',shelved_image_id='0bc8c3c4-0b8a-4d58-a899-ca83c86d171a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_vif [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499168b8-ec17-5724-b775-22e6676a781b', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767dec6-ccf6-4d83-ad3e-2fb45d658902]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = twFzeSDy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 21:28:44 user nova-compute[75409]: node.name = iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:28:44 user nova-compute[75409]: node.tpgt = -1
Nov 15 21:28:44 user nova-compute[75409]: node.startup = automatic
Nov 15 21:28:44 user nova-compute[75409]: node.leading_login = No
Nov 15 21:28:44 user nova-compute[75409]: iface.iscsi_ifacename = default
Nov 15 21:28:44 user nova-compute[75409]: iface.net_ifacename = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.ipaddress = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.prefix_len = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.hwaddress = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.transport_name = tcp
Nov 15 21:28:44 user nova-compute[75409]: iface.initiatorname = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.vlan_id = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.vlan_priority = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.vlan_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.iface_num = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.mtu = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.port = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.bootproto = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.subnet_mask = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.gateway = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_alt_client_id = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_dns = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_learn_iqn = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_vendor_id_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_vendor_id = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.dhcp_slp_da = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.fragmentation = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.gratuitous_arp = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.incoming_forwarding = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.tos_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.tos = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.ttl = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.delayed_ack = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.tcp_nagle = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.tcp_wsf_state = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.tcp_wsf = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.tcp_timer_scale = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.tcp_timestamp = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.redirect = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.def_task_mgmt_timeout = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.header_digest = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.data_digest = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.immediate_data = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.initial_r2t = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.data_seq_inorder = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.data_pdu_inorder = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.erl = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.max_receive_data_len = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.first_burst_len = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.max_outstanding_r2t = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.max_burst_len = 0
Nov 15 21:28:44 user nova-compute[75409]: iface.chap_auth = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.bidi_chap = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.strict_login_compliance = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.discovery_auth = <empty>
Nov 15 21:28:44 user nova-compute[75409]: iface.discovery_logout = <empty>
Nov 15 21:28:44 user nova-compute[75409]: node.discovery_address = <empty>
Nov 15 21:28:44 user nova-compute[75409]: node.discovery_port = 0
Nov 15 21:28:44 user nova-compute[75409]: node.discovery_type = static
Nov 15 21:28:44 user nova-compute[75409]: node.session.initial_cmdsn = 0
Nov 15 21:28:44 user nova-compute[75409]: node.session.initial_login_retry_max = 8
Nov 15 21:28:44 user nova-compute[75409]: node.session.xmit_thread_priority = -20
Nov 15 21:28:44 user nova-compute[75409]: node.session.cmds_max = 128
Nov 15 21:28:44 user nova-compute[75409]: node.session.queue_depth = 32
Nov 15 21:28:44 user nova-compute[75409]: node.session.nr_sessions = 1
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.authmethod = CHAP
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.username = twFzeSDy
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.password = ***
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.username_in = <empty>
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.password_in = <empty>
Nov 15 21:28:44 user nova-compute[75409]: node.session.auth.chap_algs = MD5
Nov 15 21:28:44 user nova-compute[75409]: node.session.timeo.replacement_timeout = 120
Nov 15 21:28:44 user nova-compute[75409]: node.session.err_timeo.abort_timeout = 15
Nov 15 21:28:44 user nova-compute[75409]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 21:28:44 user nova-compute[75409]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 21:28:44 user nova-compute[75409]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.FastAbort = Yes
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.InitialR2T = No
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.ImmediateData = Yes
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.MaxConnections = 1
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 21:28:44 user nova-compute[75409]: node.session.iscsi.ERL = 0
Nov 15 21:28:44 user nova-compute[75409]: node.session.scan = manual
Nov 15 21:28:44 user nova-compute[75409]: node.session.reopen_max = 0
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].address = 172.16.0.220
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].port = 3260
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].startup = manual
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].tcp.window_size = 524288
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].tcp.type_of_service = 0
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].timeo.logout_timeout = 15
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].timeo.login_timeout = 15
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].timeo.auth_timeout = 45
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.DataDigest = None
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.IFMarker = No
Nov 15 21:28:44 user nova-compute[75409]: node.conn[0].iscsi.OFMarker = No
Nov 15 21:28:44 user nova-compute[75409]: # END RECORD
Nov 15 21:28:44 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Attempting to detach device vdb from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:44 user nova-compute[75409]:   <source dev="/dev/sdf"/>
Nov 15 21:28:44 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:   <serial>69edd15b-f331-479a-81cc-c00fadaac969</serial>
Nov 15 21:28:44 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:28:44 user nova-compute[75409]: </disk>
Nov 15 21:28:44 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd098b838-c6, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd098b838-c6, col_values=(('qos', UUID('e3027647-73b8-4a0f-b74a-96c306059912')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd098b838-c6, col_values=(('external_ids', {'iface-id': 'd098b838-c6bc-49e1-9021-293a1b527c93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:59:0d', 'vm-uuid': '77ef017e-9905-491a-9def-b81e289ac07b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully detached device vdb from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the persistent domain config.
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:44 user nova-compute[75409]:   <source dev="/dev/sdf"/>
Nov 15 21:28:44 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:   <serial>69edd15b-f331-479a-81cc-c00fadaac969</serial>
Nov 15 21:28:44 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:28:44 user nova-compute[75409]: </disk>
Nov 15 21:28:44 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e3cb7-e4a8-42ea-b4b7-48fd45014e41]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:44 user nova-compute[75409]: INFO os_vif [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6')
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa048f0-7fbd-4702-904c-2f597187ac86]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twFzeSDy {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twFzeSDy" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a43dc2f-3d6e-4004-95df-b94d78f97843]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'twFzeSDy'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No VIF found with MAC fa:16:3e:c5:59:0d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2177607f-3556-473b-abda-309aecb864fb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a25a7e-1769-4c6f-91d9-3c7ea5a0e611]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:28:44 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] HCTL ('34', '0', '0', 0) found on session 19 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f75111-f65f-4183-868a-9007effac0b5]: (4, ('0 0 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Searching for a device in session 19 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.228s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] <== connect_volume: return (229ms) {'type': 'block', 'scsi_wwn': '23936623437316238', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936623437316238', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1024966487',display_name='tempest-ServerStableDeviceRescueTest-server-1024966487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1024966487',id=3,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1w3IwZQuzhmYOZjDB4CqzB1nMbLgLze4h5chIWpKA4h1n2nTIX0cJ63BLH/trwf5U0b+0WEPiz8w1cfw9G1Qlei7+sz4fsrvhsxZbXV12IkJeUKMyv1vf8JHbr5WdKLA==',key_name='tempest-keypair-1226690818',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d175092693d4075a673abd4700224b4',ramdisk_id='',reservation_id='r-l0an1ygs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1415887716',owner_user_name='tempest-ServerStableDeviceRescueTest-1415887716-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc1671b61544734b8af9c67182684ad',uuid=c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "vif_mac": "fa:16:3e:82:40:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converting VIF {"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "vif_mac": "fa:16:3e:82:40:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.objects.base [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Object Instance<c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:28:44 user nova-compute[75409]:   <uuid>c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</uuid>
Nov 15 21:28:44 user nova-compute[75409]:   <name>instance-00000003</name>
Nov 15 21:28:44 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:28:44 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:28:44 user nova-compute[75409]:   <metadata>
Nov 15 21:28:44 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:28:44 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1024966487</nova:name>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:28:44</nova:creationTime>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:28:44 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:owner>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:user uuid="4dc1671b61544734b8af9c67182684ad">tempest-ServerStableDeviceRescueTest-1415887716-project-member</nova:user>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:project uuid="6d175092693d4075a673abd4700224b4">tempest-ServerStableDeviceRescueTest-1415887716</nova:project>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:owner>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:28:44 user nova-compute[75409]:       <nova:ports>
Nov 15 21:28:44 user nova-compute[75409]:         <nova:port uuid="35d82c8f-3046-4e3b-85ba-ba91853e4cb5">
Nov 15 21:28:44 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:28:44 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:44 user nova-compute[75409]:       </nova:ports>
Nov 15 21:28:44 user nova-compute[75409]:     </nova:instance>
Nov 15 21:28:44 user nova-compute[75409]:   </metadata>
Nov 15 21:28:44 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:28:44 user nova-compute[75409]:     <system>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="serial">c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="uuid">c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a</entry>
Nov 15 21:28:44 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:28:44 user nova-compute[75409]:     </system>
Nov 15 21:28:44 user nova-compute[75409]:   </sysinfo>
Nov 15 21:28:44 user nova-compute[75409]:   <os>
Nov 15 21:28:44 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:28:44 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:28:44 user nova-compute[75409]:   </os>
Nov 15 21:28:44 user nova-compute[75409]:   <features>
Nov 15 21:28:44 user nova-compute[75409]:     <acpi/>
Nov 15 21:28:44 user nova-compute[75409]:     <apic/>
Nov 15 21:28:44 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:28:44 user nova-compute[75409]:   </features>
Nov 15 21:28:44 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:28:44 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:28:44 user nova-compute[75409]:   </clock>
Nov 15 21:28:44 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:28:44 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:28:44 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:28:44 user nova-compute[75409]:   </cpu>
Nov 15 21:28:44 user nova-compute[75409]:   <devices>
Nov 15 21:28:44 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:28:44 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:     </disk>
Nov 15 21:28:44 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:28:44 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:       <serial>f0db07f5-a51b-48cf-9842-0c6f1cd573e0</serial>
Nov 15 21:28:44 user nova-compute[75409]:     </disk>
Nov 15 21:28:44 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:28:44 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:28:44 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="vdc" bus="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:       <boot order="1"/>
Nov 15 21:28:44 user nova-compute[75409]:     </disk>
Nov 15 21:28:44 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:44 user nova-compute[75409]:       <mac address="fa:16:3e:82:40:c6"/>
Nov 15 21:28:44 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:44 user nova-compute[75409]:       <target dev="tap35d82c8f-30"/>
Nov 15 21:28:44 user nova-compute[75409]:     </interface>
Nov 15 21:28:44 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:28:44 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/console.log" append="off"/>
Nov 15 21:28:44 user nova-compute[75409]:     </serial>
Nov 15 21:28:44 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:28:44 user nova-compute[75409]:     <video>
Nov 15 21:28:44 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:44 user nova-compute[75409]:     </video>
Nov 15 21:28:44 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:28:44 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:28:44 user nova-compute[75409]:     </rng>
Nov 15 21:28:44 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:28:44 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:28:44 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:28:44 user nova-compute[75409]:     </memballoon>
Nov 15 21:28:44 user nova-compute[75409]:   </devices>
Nov 15 21:28:44 user nova-compute[75409]: </domain>
Nov 15 21:28:44 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance destroyed successfully.
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.policy [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da1a39965eca49a3968d2f663ee23456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7db8991da84139a8cf85771d3ec173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] No VIF found with MAC fa:16:3e:82:40:c6, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:28:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Creating image(s)
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "/opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "/opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk 1073741824" returned: 0 in 0.063s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Successfully created port: 3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Cannot resize image /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Ensure instance console log exists: /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Successfully updated port: 3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquired lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-changed-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Refreshing instance network info cache due to event network-changed-3da23f80-c159-45e8-86be-496fbca82ab6. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] Acquiring lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Updating instance_info_cache with network_info: [{"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Releasing lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Instance network_info: |[{"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] Acquired lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Refreshing network info cache for port 3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Start _get_guest_xml network_info=[{"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:28:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616068173',display_name='tempest-VolumesActionsTest-instance-616068173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616068173',id=14,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-flwy85x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:45Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=ad612188-0e18-450b-ba0e-41b3d8e26016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lazy-loading 'pci_devices' on Instance uuid ad612188-0e18-450b-ba0e-41b3d8e26016 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:28:46 user nova-compute[75409]:   <uuid>ad612188-0e18-450b-ba0e-41b3d8e26016</uuid>
Nov 15 21:28:46 user nova-compute[75409]:   <name>instance-0000000e</name>
Nov 15 21:28:46 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:28:46 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:28:46 user nova-compute[75409]:   <metadata>
Nov 15 21:28:46 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:28:46 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:name>tempest-VolumesActionsTest-instance-616068173</nova:name>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:28:46</nova:creationTime>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:28:46 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:28:46 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:owner>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:user uuid="da1a39965eca49a3968d2f663ee23456">tempest-VolumesActionsTest-1907874876-project-member</nova:user>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:project uuid="4a7db8991da84139a8cf85771d3ec173">tempest-VolumesActionsTest-1907874876</nova:project>
Nov 15 21:28:46 user nova-compute[75409]:       </nova:owner>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:28:46 user nova-compute[75409]:       <nova:ports>
Nov 15 21:28:46 user nova-compute[75409]:         <nova:port uuid="3da23f80-c159-45e8-86be-496fbca82ab6">
Nov 15 21:28:46 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:28:46 user nova-compute[75409]:         </nova:port>
Nov 15 21:28:46 user nova-compute[75409]:       </nova:ports>
Nov 15 21:28:46 user nova-compute[75409]:     </nova:instance>
Nov 15 21:28:46 user nova-compute[75409]:   </metadata>
Nov 15 21:28:46 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:28:46 user nova-compute[75409]:     <system>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="serial">ad612188-0e18-450b-ba0e-41b3d8e26016</entry>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="uuid">ad612188-0e18-450b-ba0e-41b3d8e26016</entry>
Nov 15 21:28:46 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:28:46 user nova-compute[75409]:     </system>
Nov 15 21:28:46 user nova-compute[75409]:   </sysinfo>
Nov 15 21:28:46 user nova-compute[75409]:   <os>
Nov 15 21:28:46 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:28:46 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:28:46 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:28:46 user nova-compute[75409]:   </os>
Nov 15 21:28:46 user nova-compute[75409]:   <features>
Nov 15 21:28:46 user nova-compute[75409]:     <acpi/>
Nov 15 21:28:46 user nova-compute[75409]:     <apic/>
Nov 15 21:28:46 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:28:46 user nova-compute[75409]:   </features>
Nov 15 21:28:46 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:28:46 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:28:46 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:28:46 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:28:46 user nova-compute[75409]:   </clock>
Nov 15 21:28:46 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:28:46 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:28:46 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:28:46 user nova-compute[75409]:   </cpu>
Nov 15 21:28:46 user nova-compute[75409]:   <devices>
Nov 15 21:28:46 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:28:46 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:28:46 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk"/>
Nov 15 21:28:46 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:28:46 user nova-compute[75409]:     </disk>
Nov 15 21:28:46 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:28:46 user nova-compute[75409]:       <mac address="fa:16:3e:52:25:55"/>
Nov 15 21:28:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:46 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:28:46 user nova-compute[75409]:       <target dev="tap3da23f80-c1"/>
Nov 15 21:28:46 user nova-compute[75409]:     </interface>
Nov 15 21:28:46 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:28:46 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/console.log" append="off"/>
Nov 15 21:28:46 user nova-compute[75409]:     </serial>
Nov 15 21:28:46 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:28:46 user nova-compute[75409]:     <video>
Nov 15 21:28:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:28:46 user nova-compute[75409]:     </video>
Nov 15 21:28:46 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:28:46 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:28:46 user nova-compute[75409]:     </rng>
Nov 15 21:28:46 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:28:46 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:28:46 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:28:46 user nova-compute[75409]:     </memballoon>
Nov 15 21:28:46 user nova-compute[75409]:   </devices>
Nov 15 21:28:46 user nova-compute[75409]: </domain>
Nov 15 21:28:46 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616068173',display_name='tempest-VolumesActionsTest-instance-616068173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616068173',id=14,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-flwy85x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:28:45Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=ad612188-0e18-450b-ba0e-41b3d8e26016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG os_vif [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aca7c68-ada7-554e-8edc-5d7d159fa02b', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3da23f80-c1, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3da23f80-c1, col_values=(('qos', UUID('71eb0e8e-2b4a-46b5-824a-e51e1d49851f')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3da23f80-c1, col_values=(('external_ids', {'iface-id': '3da23f80-c159-45e8-86be-496fbca82ab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:25:55', 'vm-uuid': 'ad612188-0e18-450b-ba0e-41b3d8e26016'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:46 user nova-compute[75409]: INFO os_vif [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1')
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] No VIF found with MAC fa:16:3e:52:25:55, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Updated VIF entry in instance network info cache for port 3da23f80-c159-45e8-86be-496fbca82ab6. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Updating instance_info_cache with network_info: [{"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8520e3bd-b9a5-429a-9cfb-12355f6f7a19 req-e46c669d-ac2d-46e0-a4ba-4ff50a4266c0 service nova] Releasing lock "refresh_cache-ad612188-0e18-450b-ba0e-41b3d8e26016" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:47 user nova-compute[75409]: WARNING nova.compute.manager [req-09935583-92e0-4444-b577-b51d2b46008a req-19bcd80c-0dc5-4991-b399-f35f31b49896 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state rescuing.
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:49 user nova-compute[75409]: WARNING nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state active and task_state rescuing.
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:49 user nova-compute[75409]: WARNING nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:50 user nova-compute[75409]: WARNING nova.compute.manager [req-845ab316-bb60-436f-ae16-57a07de58710 req-4406c907-a9b5-409e-a942-40f7e8262ffc service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 21:28:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] No waiting events found dispatching network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:50 user nova-compute[75409]: WARNING nova.compute.manager [req-c886d33f-a19b-4eba-948b-5a050687856b req-acf495cc-7a0b-4072-926f-6af9929f4b51 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received unexpected event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 for instance with vm_state building and task_state spawning.
Nov 15 21:28:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7771ac6c-c060-42de-b2e0-c92a656f7c15 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:28:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:28:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:28:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance spawned successfully.
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:28:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Instance spawned successfully.
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] No waiting events found dispatching network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:28:52 user nova-compute[75409]: WARNING nova.compute.manager [req-3efd66cc-ab27-4023-96e1-f2df39d4184f req-3ec1d393-d8a1-40f6-83e2-61b1a3ae16d2 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received unexpected event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 for instance with vm_state building and task_state spawning.
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:28:52 user nova-compute[75409]: INFO nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:28:52 user nova-compute[75409]: INFO nova.compute.manager [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Took 8.34 seconds to build instance.
Nov 15 21:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cc7a484c-2844-47e2-a7a7-04135d3b4002 tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.500s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-54c25324-831f-4f46-b0e3-186d9f6c4355 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.960s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:28:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:28:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b is timed out.
Nov 15 21:29:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully detached device vdb from instance 0208271e-c742-4fb4-8ae8-1fe9907d677b from the live domain config.
Nov 15 21:29:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRQvgPJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:29:05 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.045s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281db2d-60f1-49bb-972d-0cf17e51c53c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:29:05 user nova-compute[75409]: No targets found.
Nov 15 21:29:05 user nova-compute[75409]: iSNS:
Nov 15 21:29:05 user nova-compute[75409]: No targets found.
Nov 15 21:29:05 user nova-compute[75409]: STATIC:
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:29:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:05 user nova-compute[75409]: FIRMWARE:
Nov 15 21:29:05 user nova-compute[75409]: No targets found.
Nov 15 21:29:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:29:05 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:29:05 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4236acc-391d-4f24-b7a4-165d9b2d3cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de1621-021a-4a9a-97e1-13a0af2bed87]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:29:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969'): ({'sdf'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Removing single pathed devices sdf {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415bb57-69e7-4bc4-88c4-6b848c0b9e6f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b22bb-129e-4448-8fcf-61e875fd6191]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Flushing IO for device /dev/sdf {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[068f490a-0e6a-4fef-97f3-0ef9029b8927]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55941621-2c25-4659-b35b-7ca81b115645]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae63010-37f7-4fb0-aa49-d7ed26b34e4a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a857b5c8-f4b2-4023-a7e4-a60fc458eaaa]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260]
Nov 15 21:29:05 user nova-compute[75409]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969, portal: 172.16.0.220,3260] successful.
Nov 15 21:29:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69edd15b-f331-479a-81cc-c00fadaac969 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce78c61b-0a60-470b-9fe5-898f8c746060]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] <== disconnect_volume: return (451ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:29:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'flavor' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-32363655-e5f7-4497-b602-e208553541c6 tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.501s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:10 user nova-compute[75409]: INFO nova.compute.claims [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Claim successful on node user
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:10 user nova-compute[75409]: DEBUG nova.policy [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e81a94d16ea245199ef3e5eda3504e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1cf2e458a42038e1d791ae5fd2a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Creating image(s)
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "/opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "/opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.275s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.209s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Successfully created port: 41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk 1073741824" returned: 0 in 0.060s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Cannot resize image /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Ensure instance console log exists: /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:12 user nova-compute[75409]: INFO nova.compute.claims [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Claim successful on node user
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Successfully updated port: 41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquired lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-changed-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Refreshing instance network info cache due to event network-changed-41267a36-8581-4112-9fb3-6ab7b641c7a0. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] Acquiring lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.policy [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d5e54d2abc4dd78b4b18e002ddbd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5836aea124274a11f184cdb783429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Creating image(s)
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:12 user nova-compute[75409]: INFO nova.compute.claims [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Claim successful on node user
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Releasing lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Instance network_info: |[{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] Acquired lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Refreshing network info cache for port 41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Start _get_guest_xml network_info=[{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1719741',id=15,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbR69zJNLPyfBV0/KK8TLrS7/jC7X6DQ1uBzu/szPRKrFzvIGHZJmhnvfkSO0hFmEb/58X2hCr/Hp7kR64eezoxg0hV9WgEVw/TJ/NGO/7RLllIOTBbNNmyiPuCEUStAA==',key_name='tempest-keypair-956081336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90b1cf2e458a42038e1d791ae5fd2a68',ramdisk_id='',reservation_id='r-75yqigx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81a94d16ea245199ef3e5eda3504e0f',uuid=cd3765d7-3e52-4478-9c46-4aea89707638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converting VIF {"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lazy-loading 'pci_devices' on Instance uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:13 user nova-compute[75409]:   <uuid>cd3765d7-3e52-4478-9c46-4aea89707638</uuid>
Nov 15 21:29:13 user nova-compute[75409]:   <name>instance-0000000f</name>
Nov 15 21:29:13 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:13 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:13 user nova-compute[75409]:   <metadata>
Nov 15 21:29:13 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:13 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347</nova:name>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:12</nova:creationTime>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:13 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:13 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:user uuid="e81a94d16ea245199ef3e5eda3504e0f">tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member</nova:user>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:project uuid="90b1cf2e458a42038e1d791ae5fd2a68">tempest-TestServerVolumeAttachScenarioOldVersion-1894207315</nova:project>
Nov 15 21:29:13 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:29:13 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:13 user nova-compute[75409]:         <nova:port uuid="41267a36-8581-4112-9fb3-6ab7b641c7a0">
Nov 15 21:29:13 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 21:29:13 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:13 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:13 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:13 user nova-compute[75409]:   </metadata>
Nov 15 21:29:13 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:13 user nova-compute[75409]:     <system>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="serial">cd3765d7-3e52-4478-9c46-4aea89707638</entry>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="uuid">cd3765d7-3e52-4478-9c46-4aea89707638</entry>
Nov 15 21:29:13 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:13 user nova-compute[75409]:     </system>
Nov 15 21:29:13 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:13 user nova-compute[75409]:   <os>
Nov 15 21:29:13 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:13 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:13 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:13 user nova-compute[75409]:   </os>
Nov 15 21:29:13 user nova-compute[75409]:   <features>
Nov 15 21:29:13 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:13 user nova-compute[75409]:     <apic/>
Nov 15 21:29:13 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:13 user nova-compute[75409]:   </features>
Nov 15 21:29:13 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:13 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:13 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:13 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:13 user nova-compute[75409]:   </clock>
Nov 15 21:29:13 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:13 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:13 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:13 user nova-compute[75409]:   </cpu>
Nov 15 21:29:13 user nova-compute[75409]:   <devices>
Nov 15 21:29:13 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:13 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:13 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk"/>
Nov 15 21:29:13 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:29:13 user nova-compute[75409]:     </disk>
Nov 15 21:29:13 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:13 user nova-compute[75409]:       <mac address="fa:16:3e:3a:0a:7e"/>
Nov 15 21:29:13 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:13 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:13 user nova-compute[75409]:       <target dev="tap41267a36-85"/>
Nov 15 21:29:13 user nova-compute[75409]:     </interface>
Nov 15 21:29:13 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:13 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/console.log" append="off"/>
Nov 15 21:29:13 user nova-compute[75409]:     </serial>
Nov 15 21:29:13 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:13 user nova-compute[75409]:     <video>
Nov 15 21:29:13 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:13 user nova-compute[75409]:     </video>
Nov 15 21:29:13 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:13 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:13 user nova-compute[75409]:     </rng>
Nov 15 21:29:13 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:13 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:13 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:13 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:13 user nova-compute[75409]:   </devices>
Nov 15 21:29:13 user nova-compute[75409]: </domain>
Nov 15 21:29:13 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1719741',id=15,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbR69zJNLPyfBV0/KK8TLrS7/jC7X6DQ1uBzu/szPRKrFzvIGHZJmhnvfkSO0hFmEb/58X2hCr/Hp7kR64eezoxg0hV9WgEVw/TJ/NGO/7RLllIOTBbNNmyiPuCEUStAA==',key_name='tempest-keypair-956081336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90b1cf2e458a42038e1d791ae5fd2a68',ramdisk_id='',reservation_id='r-75yqigx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81a94d16ea245199ef3e5eda3504e0f',uuid=cd3765d7-3e52-4478-9c46-4aea89707638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converting VIF {"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG os_vif [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '722de567-3054-5135-8648-1d245321b0fa', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41267a36-85, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41267a36-85, col_values=(('qos', UUID('e7c530ab-2b83-4114-9b17-6e96abd346cd')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41267a36-85, col_values=(('external_ids', {'iface-id': '41267a36-8581-4112-9fb3-6ab7b641c7a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:0a:7e', 'vm-uuid': 'cd3765d7-3e52-4478-9c46-4aea89707638'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: INFO os_vif [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85')
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk 1073741824" returned: 0 in 0.054s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] No VIF found with MAC fa:16:3e:3a:0a:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Successfully created port: 2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Cannot resize image /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Ensure instance console log exists: /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.neutron [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updated VIF entry in instance network info cache for port 41267a36-8581-4112-9fb3-6ab7b641c7a0. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.network.neutron [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.policy [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '098f422f38cb4addab5b34395aac505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009284b3fdbd4f4ab5887b35b1fc56cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Creating image(s)
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "/opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "/opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "/opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d071a579-43c4-434a-91b4-0e6837f09e92 req-87e42b4b-088f-4d2d-bdaf-773aa4d2cca8 service nova] Releasing lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk 1073741824" returned: 0 in 0.051s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Cannot resize image /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Ensure instance console log exists: /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] No waiting events found dispatching network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:15 user nova-compute[75409]: WARNING nova.compute.manager [req-09810f31-e772-4335-ae3a-5faaa99243cb req-007018ec-af26-4694-9e90-f855f445578f service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received unexpected event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 for instance with vm_state building and task_state spawning.
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Successfully updated port: 2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-changed-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Refreshing instance network info cache due to event network-changed-2c9dd991-6743-45f3-af24-cd08422d3843. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Successfully created port: 69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance network_info: |[{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.neutron [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Refreshing network info cache for port 2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start _get_guest_xml network_info=[{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:16 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:16 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'pci_devices' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:16 user nova-compute[75409]:   <uuid>ff35ef10-9b97-4082-bf02-8fa4d9db9063</uuid>
Nov 15 21:29:16 user nova-compute[75409]:   <name>instance-00000010</name>
Nov 15 21:29:16 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:16 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:16 user nova-compute[75409]:   <metadata>
Nov 15 21:29:16 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:16 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherB-server-405583289</nova:name>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:16</nova:creationTime>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:16 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:16 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:user uuid="53d5e54d2abc4dd78b4b18e002ddbd96">tempest-ServerActionsTestOtherB-729308147-project-member</nova:user>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:project uuid="b0c5836aea124274a11f184cdb783429">tempest-ServerActionsTestOtherB-729308147</nova:project>
Nov 15 21:29:16 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:29:16 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:16 user nova-compute[75409]:         <nova:port uuid="2c9dd991-6743-45f3-af24-cd08422d3843">
Nov 15 21:29:16 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:29:16 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:16 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:16 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:16 user nova-compute[75409]:   </metadata>
Nov 15 21:29:16 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:16 user nova-compute[75409]:     <system>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="serial">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="uuid">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:29:16 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:16 user nova-compute[75409]:     </system>
Nov 15 21:29:16 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:16 user nova-compute[75409]:   <os>
Nov 15 21:29:16 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:16 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:16 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:16 user nova-compute[75409]:   </os>
Nov 15 21:29:16 user nova-compute[75409]:   <features>
Nov 15 21:29:16 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:16 user nova-compute[75409]:     <apic/>
Nov 15 21:29:16 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:16 user nova-compute[75409]:   </features>
Nov 15 21:29:16 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:16 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:16 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:16 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:16 user nova-compute[75409]:   </clock>
Nov 15 21:29:16 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:16 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:16 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:16 user nova-compute[75409]:   </cpu>
Nov 15 21:29:16 user nova-compute[75409]:   <devices>
Nov 15 21:29:16 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:16 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:16 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk"/>
Nov 15 21:29:16 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:29:16 user nova-compute[75409]:     </disk>
Nov 15 21:29:16 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:16 user nova-compute[75409]:       <mac address="fa:16:3e:02:ec:b2"/>
Nov 15 21:29:16 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:16 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:16 user nova-compute[75409]:       <target dev="tap2c9dd991-67"/>
Nov 15 21:29:16 user nova-compute[75409]:     </interface>
Nov 15 21:29:16 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:16 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/console.log" append="off"/>
Nov 15 21:29:16 user nova-compute[75409]:     </serial>
Nov 15 21:29:16 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:16 user nova-compute[75409]:     <video>
Nov 15 21:29:16 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:16 user nova-compute[75409]:     </video>
Nov 15 21:29:16 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:16 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:16 user nova-compute[75409]:     </rng>
Nov 15 21:29:16 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:16 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:16 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:16 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:16 user nova-compute[75409]:   </devices>
Nov 15 21:29:16 user nova-compute[75409]: </domain>
Nov 15 21:29:16 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG os_vif [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3facbe5a-89ea-5d39-97a0-0a2e891fabc2', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c9dd991-67, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c9dd991-67, col_values=(('qos', UUID('f95c77e3-55f0-42d6-9bb5-af3132138a28')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c9dd991-67, col_values=(('external_ids', {'iface-id': '2c9dd991-6743-45f3-af24-cd08422d3843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ec:b2', 'vm-uuid': 'ff35ef10-9b97-4082-bf02-8fa4d9db9063'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:16 user nova-compute[75409]: INFO os_vif [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No VIF found with MAC fa:16:3e:02:ec:b2, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] No waiting events found dispatching network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:17 user nova-compute[75409]: WARNING nova.compute.manager [req-d6e4b1bf-6ea0-46d0-aaaf-df30c3a6f42f req-8fb52fb5-1705-4dc8-bc1c-db908125e62a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received unexpected event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 for instance with vm_state building and task_state spawning.
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updated VIF entry in instance network info cache for port 2c9dd991-6743-45f3-af24-cd08422d3843. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Successfully updated port: 69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquired lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51ac34a6-1f65-4c0d-a6c3-8fa6261c8a5f req-ac778376-33d9-49f9-9f14-a59f64fa9092 service nova] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-changed-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Refreshing instance network info cache due to event network-changed-69936157-ea9c-4bd6-8ad9-42df18e567be. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] Acquiring lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Instance spawned successfully.
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updating instance_info_cache with network_info: [{"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:17 user nova-compute[75409]: INFO nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Releasing lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Instance network_info: |[{"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] Acquired lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Refreshing network info cache for port 69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Start _get_guest_xml network_info=[{"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1989092853',display_name='tempest-VolumesSnapshotTestJSON-instance-1989092853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1989092853',id=17,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3W5YGl5Vx30PEfk+3q7Xe/zx+MrlrpUOnjn+mDmUGTd0rM/6xNP8dX3flnGGG8bT/YbVTHEpJInQOgZ4q9eluOuzxns11epcPXokufv5aK219L5BX04c2QtdAo/Pkz9Q==',key_name='tempest-keypair-149374748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-f0cgzspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=4053527e-16c3-436b-916f-9d7ca3d2a11c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.objects.instance [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'pci_devices' on Instance uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:18 user nova-compute[75409]:   <uuid>4053527e-16c3-436b-916f-9d7ca3d2a11c</uuid>
Nov 15 21:29:18 user nova-compute[75409]:   <name>instance-00000011</name>
Nov 15 21:29:18 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:18 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:18 user nova-compute[75409]:   <metadata>
Nov 15 21:29:18 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:18 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1989092853</nova:name>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:17</nova:creationTime>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:18 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:18 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:user uuid="098f422f38cb4addab5b34395aac505a">tempest-VolumesSnapshotTestJSON-2115825168-project-member</nova:user>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:project uuid="009284b3fdbd4f4ab5887b35b1fc56cb">tempest-VolumesSnapshotTestJSON-2115825168</nova:project>
Nov 15 21:29:18 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:29:18 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:18 user nova-compute[75409]:         <nova:port uuid="69936157-ea9c-4bd6-8ad9-42df18e567be">
Nov 15 21:29:18 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 21:29:18 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:18 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:18 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:18 user nova-compute[75409]:   </metadata>
Nov 15 21:29:18 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:18 user nova-compute[75409]:     <system>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="serial">4053527e-16c3-436b-916f-9d7ca3d2a11c</entry>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="uuid">4053527e-16c3-436b-916f-9d7ca3d2a11c</entry>
Nov 15 21:29:18 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:18 user nova-compute[75409]:     </system>
Nov 15 21:29:18 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:18 user nova-compute[75409]:   <os>
Nov 15 21:29:18 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:18 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:18 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:18 user nova-compute[75409]:   </os>
Nov 15 21:29:18 user nova-compute[75409]:   <features>
Nov 15 21:29:18 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:18 user nova-compute[75409]:     <apic/>
Nov 15 21:29:18 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:18 user nova-compute[75409]:   </features>
Nov 15 21:29:18 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:18 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:18 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:18 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:18 user nova-compute[75409]:   </clock>
Nov 15 21:29:18 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:18 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:18 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:18 user nova-compute[75409]:   </cpu>
Nov 15 21:29:18 user nova-compute[75409]:   <devices>
Nov 15 21:29:18 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:18 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:18 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk"/>
Nov 15 21:29:18 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:29:18 user nova-compute[75409]:     </disk>
Nov 15 21:29:18 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:18 user nova-compute[75409]:       <mac address="fa:16:3e:6b:96:4e"/>
Nov 15 21:29:18 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:18 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:18 user nova-compute[75409]:       <target dev="tap69936157-ea"/>
Nov 15 21:29:18 user nova-compute[75409]:     </interface>
Nov 15 21:29:18 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:18 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/console.log" append="off"/>
Nov 15 21:29:18 user nova-compute[75409]:     </serial>
Nov 15 21:29:18 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:18 user nova-compute[75409]:     <video>
Nov 15 21:29:18 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:18 user nova-compute[75409]:     </video>
Nov 15 21:29:18 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:18 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:18 user nova-compute[75409]:     </rng>
Nov 15 21:29:18 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:18 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:18 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:18 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:18 user nova-compute[75409]:   </devices>
Nov 15 21:29:18 user nova-compute[75409]: </domain>
Nov 15 21:29:18 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1989092853',display_name='tempest-VolumesSnapshotTestJSON-instance-1989092853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1989092853',id=17,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3W5YGl5Vx30PEfk+3q7Xe/zx+MrlrpUOnjn+mDmUGTd0rM/6xNP8dX3flnGGG8bT/YbVTHEpJInQOgZ4q9eluOuzxns11epcPXokufv5aK219L5BX04c2QtdAo/Pkz9Q==',key_name='tempest-keypair-149374748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-f0cgzspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=4053527e-16c3-436b-916f-9d7ca3d2a11c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG os_vif [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:18 user nova-compute[75409]: INFO nova.compute.manager [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Took 7.82 seconds to build instance.
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d6e64e6-01dc-5f2e-a0b2-97b5024e6c97', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69936157-ea, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69936157-ea, col_values=(('qos', UUID('8bff773a-acb1-4db0-9b5f-a120863f3ffc')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69936157-ea, col_values=(('external_ids', {'iface-id': '69936157-ea9c-4bd6-8ad9-42df18e567be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:96:4e', 'vm-uuid': '4053527e-16c3-436b-916f-9d7ca3d2a11c'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e8b27e4f-b4c1-402a-8118-71e28ef84dad tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.999s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:18 user nova-compute[75409]: INFO os_vif [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea')
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No VIF found with MAC fa:16:3e:6b:96:4e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updated VIF entry in instance network info cache for port 69936157-ea9c-4bd6-8ad9-42df18e567be. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updating instance_info_cache with network_info: [{"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-51d74366-81e8-4ece-bb6a-d28db60eb620 req-cffeb52e-52de-4970-8b24-30a1d2e8a1fa service nova] Releasing lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:19 user nova-compute[75409]: WARNING nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state building and task_state spawning.
Nov 15 21:29:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:19 user nova-compute[75409]: WARNING nova.compute.manager [req-5532e474-82c0-4659-964d-0bbc05b11a51 req-0d509c08-94c7-439f-ab7e-d391a0c60d15 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state building and task_state spawning.
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:20 user nova-compute[75409]: WARNING nova.compute.manager [req-af71dc03-6c2e-46ca-856f-198d3f42e462 req-0de887bd-f0a5-492f-bdde-95c32a2adeda service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state building and task_state spawning.
Nov 15 21:29:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance spawned successfully.
Nov 15 21:29:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Took 9.30 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.compute.manager [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Took 10.31 seconds to build instance.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8a8cbc2c-4a69-4e65-aded-34efbacc3a9f tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.603s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:22 user nova-compute[75409]: WARNING nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state building and task_state spawning.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing instance network info cache due to event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.compute.manager [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Detaching volume ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Instance spawned successfully.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.virt.block_device [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Attempting to driver detach volume ae3ee946-f24e-4391-be38-b00fbdb77693 from mountpoint /dev/vdb
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Attempting to detach device vdb from instance bac6908e-d641-439c-bb4c-8a86352bb9d9 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:29:22 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:29:22 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:29:22 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:29:22 user nova-compute[75409]:   <serial>ae3ee946-f24e-4391-be38-b00fbdb77693</serial>
Nov 15 21:29:22 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:29:22 user nova-compute[75409]: </disk>
Nov 15 21:29:22 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Took 8.81 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully detached device vdb from instance bac6908e-d641-439c-bb4c-8a86352bb9d9 from the persistent domain config.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bac6908e-d641-439c-bb4c-8a86352bb9d9 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:29:22 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:29:22 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:29:22 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:29:22 user nova-compute[75409]:   <serial>ae3ee946-f24e-4391-be38-b00fbdb77693</serial>
Nov 15 21:29:22 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:29:22 user nova-compute[75409]: </disk>
Nov 15 21:29:22 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:29:22 user nova-compute[75409]: INFO nova.compute.manager [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Took 9.94 seconds to build instance.
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30724d83-5d0e-4c34-965b-db48d8035fcd tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.100s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated VIF entry in instance network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing instance network info cache due to event network-changed-6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Acquiring lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Acquired lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:22 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Refreshing network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updated VIF entry in instance network info cache for port 6464f2cb-6c06-4c15-ab77-8887d3e29593. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG nova.network.neutron [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [{"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4eeed119-45e6-4181-b11f-3a184005ce38 req-6db3cf64-a666-4df5-8858-73d382951ddc service nova] Releasing lock "refresh_cache-bac6908e-d641-439c-bb4c-8a86352bb9d9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:34 user nova-compute[75409]: INFO nova.compute.manager [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Terminating instance
Nov 15 21:29:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-unplugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-unplugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-c9522580-54fe-4116-bd03-e5bdcdb0fa3c req-47a3927e-ee38-411e-a6a6-cb93414fbfa6 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-unplugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Instance destroyed successfully.
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lazy-loading 'resources' on Instance uuid 0208271e-c742-4fb4-8ae8-1fe9907d677b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-474524812',display_name='tempest-TestServerVolumeAttachmentScenario-server-474524812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-474524812',id=9,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO66HtQDin+w0UYWXfHCZWhjdSSXf3gDFBkHAOqkB0v1otiaWopjW98tiKvHjvsuIp4kxodWxrpWXZamOIfH7NIRddPZfGGRvbMbCXFnPAz+KY95iiAea2uCWyaz8TG76g==',key_name='tempest-keypair-1664206000',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26b6031968184be39b435bc6a0bd825e',ramdisk_id='',reservation_id='r-3appsicn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1699042490',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1699042490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82b0b1a90e934557867cc74995860f7e',uuid=0208271e-c742-4fb4-8ae8-1fe9907d677b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converting VIF {"id": "71ccc38c-121a-45e1-85b0-694af41fac89", "address": "fa:16:3e:f0:98:fd", "network": {"id": "cdce0548-7e9f-43aa-aedd-68696f8ef50f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1715570396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26b6031968184be39b435bc6a0bd825e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71ccc38c-12", "ovs_interfaceid": "71ccc38c-121a-45e1-85b0-694af41fac89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG os_vif [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71ccc38c-12, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b66aa6e6-03eb-499c-b80f-dc02ecd36562) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:35 user nova-compute[75409]: INFO os_vif [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:98:fd,bridge_name='br-int',has_traffic_filtering=True,id=71ccc38c-121a-45e1-85b0-694af41fac89,network=Network(cdce0548-7e9f-43aa-aedd-68696f8ef50f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71ccc38c-12')
Nov 15 21:29:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Deleting instance files /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b_del
Nov 15 21:29:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Deletion of /opt/stack/data/nova/instances/0208271e-c742-4fb4-8ae8-1fe9907d677b_del complete
Nov 15 21:29:35 user nova-compute[75409]: INFO nova.compute.manager [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 15 21:29:35 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:29:35 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:37 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Took 1.20 seconds to deallocate network for instance.
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:37 user nova-compute[75409]: WARNING nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state deleted and task_state None.
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:37 user nova-compute[75409]: WARNING nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state deleted and task_state None.
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:37 user nova-compute[75409]: WARNING nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state deleted and task_state None.
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Acquiring lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] No waiting events found dispatching network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:37 user nova-compute[75409]: WARNING nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received unexpected event network-vif-plugged-71ccc38c-121a-45e1-85b0-694af41fac89 for instance with vm_state deleted and task_state None.
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-498ae854-3df0-4ef9-8d7a-ad1edcb63745 req-f9f3d39f-9e07-4b5a-ae8b-6b5f7107d716 service nova] [instance: 0208271e-c742-4fb4-8ae8-1fe9907d677b] Received event network-vif-deleted-71ccc38c-121a-45e1-85b0-694af41fac89 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Deleted allocations for instance 0208271e-c742-4fb4-8ae8-1fe9907d677b
Nov 15 21:29:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f914708-0e3a-4bed-a2ed-3642610e279b tempest-TestServerVolumeAttachmentScenario-1699042490 tempest-TestServerVolumeAttachmentScenario-1699042490-project-member] Lock "0208271e-c742-4fb4-8ae8-1fe9907d677b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.906s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:41 user nova-compute[75409]: INFO nova.compute.claims [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Claim successful on node user
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:42 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.policy [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab9adbc384444705b6566cf97fd6bf2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afbc54d02744b01aa76fc461daa2d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:42 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Creating image(s)
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "b36079ffa3d2575110765c7bb03e63f15f193fba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "b36079ffa3d2575110765c7bb03e63f15f193fba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bac6908e-d641-439c-bb4c-8a86352bb9d9 is timed out.
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Successfully created port: 13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully detached device vdb from instance bac6908e-d641-439c-bb4c-8a86352bb9d9 from the live domain config.
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLVtJImv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:29:43 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64717c02-e7f7-41b9-9825-4eeeaa9bd8ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:29:43 user nova-compute[75409]: No targets found.
Nov 15 21:29:43 user nova-compute[75409]: iSNS:
Nov 15 21:29:43 user nova-compute[75409]: No targets found.
Nov 15 21:29:43 user nova-compute[75409]: STATIC:
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:29:43 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:29:43 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:29:43 user nova-compute[75409]: FIRMWARE:
Nov 15 21:29:43 user nova-compute[75409]: No targets found.
Nov 15 21:29:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:29:43 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:29:43 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd54aa1-f514-4e2e-86ed-5cd08995b9cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391f337-5d20-462e-bc0f-37e619ff56e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:29:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf086fcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.part --force-share --output=json" returned: 0 in 0.212s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.virt.images [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] 1c25f7be-90b0-4a48-bd5c-c439c5790464 was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.part /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f2cf03-b230-4a85-b4e3-e9cc0d7abd12]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:43 user nova-compute[75409]: INFO nova.compute.claims [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Claim successful on node user
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb34d5-a0ff-4b70-883e-3f248a3e5f0f]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a1e19-6251-4544-950e-920b9fe32471]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.076s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a900d31-9b11-49e6-a281-14ab3aa22dcc]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2254a12-3320-473f-9b74-bc17a9886f6f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --logout" returned: 0 in 0.124s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521e0c6-8d2f-4416-8136-d4b160dd94f1]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260]
Nov 15 21:29:44 user nova-compute[75409]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693, portal: 172.16.0.220,3260] successful.
Nov 15 21:29:44 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.part /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.converted" returned: 0 in 0.467s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3ee946-f24e-4391-be38-b00fbdb77693 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[97759d67-a38e-4c8b-ad9e-c3fe3329f508]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.654s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== disconnect_volume: return (655ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "b36079ffa3d2575110765c7bb03e63f15f193fba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.578s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Successfully updated port: 13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquired lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-changed-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Refreshing instance network info cache due to event network-changed-13844262-7024-4a17-aeee-e83701073134. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] Acquiring lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "b36079ffa3d2575110765c7bb03e63f15f193fba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "b36079ffa3d2575110765c7bb03e63f15f193fba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.970s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba,backing_fmt=raw /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba,backing_fmt=raw /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "b36079ffa3d2575110765c7bb03e63f15f193fba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.policy [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae40e5bccb84c50a4c93963d56469f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d130f253b745e2ac2497eebbd4cf99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Creating image(s)
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e6b0419c-45ee-4826-acf1-37a611ec6e5a tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.563s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Cannot resize image /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Ensure instance console log exists: /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updating instance_info_cache with network_info: [{"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Releasing lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Instance network_info: |[{"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] Acquired lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Refreshing network info cache for port 13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Start _get_guest_xml network_info=[{"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:29:34Z,direct_url=<?>,disk_format='qcow2',id=1c25f7be-90b0-4a48-bd5c-c439c5790464,min_disk=0,min_ram=0,name='',owner='c0ad00c07122458e878a3da27e796bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:29:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': '1c25f7be-90b0-4a48-bd5c-c439c5790464'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:29:34Z,direct_url=<?>,disk_format='qcow2',id=1c25f7be-90b0-4a48-bd5c-c439c5790464,min_disk=0,min_ram=0,name='',owner='c0ad00c07122458e878a3da27e796bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:29:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535057495',display_name='tempest-AttachSCSIVolumeTestJSON-server-535057495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535057495',id=18,image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1dUxVXx95UNnEYPCx5tbaKrkAbFEz30H2LygKzbjx9XUwO+ws3+NpPtnfjVl/JhsTKYgFl01G4roKjnsKwGyXCuA7YOmip9eEMqWusUKPmpcnAoGrpfGQJl1O6ecWrtg==',key_name='tempest-keypair-1518408183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8afbc54d02744b01aa76fc461daa2d69',ramdisk_id='',reservation_id='r-fh98op5f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418663166',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418663166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab9adbc384444705b6566cf97fd6bf2f',uuid=c63d2f15-9011-4d63-80ff-989cee557e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converting VIF {"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.objects.instance [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lazy-loading 'pci_devices' on Instance uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:45 user nova-compute[75409]:   <uuid>c63d2f15-9011-4d63-80ff-989cee557e9e</uuid>
Nov 15 21:29:45 user nova-compute[75409]:   <name>instance-00000012</name>
Nov 15 21:29:45 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:45 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:45 user nova-compute[75409]:   <metadata>
Nov 15 21:29:45 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:45 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-535057495</nova:name>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:45</nova:creationTime>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:45 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:45 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:user uuid="ab9adbc384444705b6566cf97fd6bf2f">tempest-AttachSCSIVolumeTestJSON-418663166-project-member</nova:user>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:project uuid="8afbc54d02744b01aa76fc461daa2d69">tempest-AttachSCSIVolumeTestJSON-418663166</nova:project>
Nov 15 21:29:45 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:root type="image" uuid="1c25f7be-90b0-4a48-bd5c-c439c5790464"/>
Nov 15 21:29:45 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:45 user nova-compute[75409]:         <nova:port uuid="13844262-7024-4a17-aeee-e83701073134">
Nov 15 21:29:45 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:29:45 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:45 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:45 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:45 user nova-compute[75409]:   </metadata>
Nov 15 21:29:45 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:45 user nova-compute[75409]:     <system>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="serial">c63d2f15-9011-4d63-80ff-989cee557e9e</entry>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="uuid">c63d2f15-9011-4d63-80ff-989cee557e9e</entry>
Nov 15 21:29:45 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:45 user nova-compute[75409]:     </system>
Nov 15 21:29:45 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:45 user nova-compute[75409]:   <os>
Nov 15 21:29:45 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:45 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:45 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:45 user nova-compute[75409]:   </os>
Nov 15 21:29:45 user nova-compute[75409]:   <features>
Nov 15 21:29:45 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:45 user nova-compute[75409]:     <apic/>
Nov 15 21:29:45 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:45 user nova-compute[75409]:   </features>
Nov 15 21:29:45 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:45 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:45 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:45 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:45 user nova-compute[75409]:   </clock>
Nov 15 21:29:45 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:45 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:45 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:45 user nova-compute[75409]:   </cpu>
Nov 15 21:29:45 user nova-compute[75409]:   <devices>
Nov 15 21:29:45 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:45 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:45 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk"/>
Nov 15 21:29:45 user nova-compute[75409]:       <target dev="sda" bus="scsi"/>
Nov 15 21:29:45 user nova-compute[75409]:       <address type="drive" controller="0" unit="0"/>
Nov 15 21:29:45 user nova-compute[75409]:     </disk>
Nov 15 21:29:45 user nova-compute[75409]:     <disk type="file" device="cdrom">
Nov 15 21:29:45 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 21:29:45 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.config"/>
Nov 15 21:29:45 user nova-compute[75409]:       <target dev="sdb" bus="scsi"/>
Nov 15 21:29:45 user nova-compute[75409]:       <address type="drive" controller="0" unit="1"/>
Nov 15 21:29:45 user nova-compute[75409]:     </disk>
Nov 15 21:29:45 user nova-compute[75409]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 21:29:45 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:45 user nova-compute[75409]:       <mac address="fa:16:3e:48:7a:9f"/>
Nov 15 21:29:45 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:45 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:45 user nova-compute[75409]:       <target dev="tap13844262-70"/>
Nov 15 21:29:45 user nova-compute[75409]:     </interface>
Nov 15 21:29:45 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:45 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/console.log" append="off"/>
Nov 15 21:29:45 user nova-compute[75409]:     </serial>
Nov 15 21:29:45 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:45 user nova-compute[75409]:     <video>
Nov 15 21:29:45 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:45 user nova-compute[75409]:     </video>
Nov 15 21:29:45 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:45 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:45 user nova-compute[75409]:     </rng>
Nov 15 21:29:45 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:45 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:45 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:45 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:45 user nova-compute[75409]:   </devices>
Nov 15 21:29:45 user nova-compute[75409]: </domain>
Nov 15 21:29:45 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535057495',display_name='tempest-AttachSCSIVolumeTestJSON-server-535057495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535057495',id=18,image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1dUxVXx95UNnEYPCx5tbaKrkAbFEz30H2LygKzbjx9XUwO+ws3+NpPtnfjVl/JhsTKYgFl01G4roKjnsKwGyXCuA7YOmip9eEMqWusUKPmpcnAoGrpfGQJl1O6ecWrtg==',key_name='tempest-keypair-1518408183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8afbc54d02744b01aa76fc461daa2d69',ramdisk_id='',reservation_id='r-fh98op5f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418663166',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418663166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab9adbc384444705b6566cf97fd6bf2f',uuid=c63d2f15-9011-4d63-80ff-989cee557e9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converting VIF {"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG os_vif [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c5b7714-45db-5dbe-af71-f526e6255a50', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13844262-70, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13844262-70, col_values=(('qos', UUID('b2c04ec9-42aa-4dd8-a26c-5e32b8ac851a')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13844262-70, col_values=(('external_ids', {'iface-id': '13844262-7024-4a17-aeee-e83701073134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:7a:9f', 'vm-uuid': 'c63d2f15-9011-4d63-80ff-989cee557e9e'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk 1073741824" returned: 0 in 0.056s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:45 user nova-compute[75409]: INFO os_vif [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70')
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No BDM found with device name sda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No VIF found with MAC fa:16:3e:48:7a:9f, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Using config drive
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Creating config drive at /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.config
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb323gefu {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Cannot resize image /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Ensure instance console log exists: /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb323gefu" returned: 0 in 0.072s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updated VIF entry in instance network info cache for port 13844262-7024-4a17-aeee-e83701073134. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updating instance_info_cache with network_info: [{"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-95b812ef-710b-4e48-af34-458ff3fbf710 req-59bbd62b-f934-4171-bf46-b2bbace925cb service nova] Releasing lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Successfully created port: 3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Successfully updated port: 3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] No waiting events found dispatching network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:49 user nova-compute[75409]: WARNING nova.compute.manager [req-67d4b48c-4383-4212-b09c-b4c0c29cbb7a req-cbf3f640-ab89-433a-bde7-58bff8b44bb8 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received unexpected event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 for instance with vm_state building and task_state spawning.
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.144378662109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Instance spawned successfully.
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:29:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing instance network info cache due to event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance bac6908e-d641-439c-bb4c-8a86352bb9d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 2768ee6d-1fca-48de-ba3c-23238efcb0eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77ef017e-9905-491a-9def-b81e289ac07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ad612188-0e18-450b-ba0e-41b3d8e26016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance cd3765d7-3e52-4478-9c46-4aea89707638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 4053527e-16c3-436b-916f-9d7ca3d2a11c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c63d2f15-9011-4d63-80ff-989cee557e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.neutron [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:50 user nova-compute[75409]: INFO nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Took 7.86 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Instance network_info: |[{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Start _get_guest_xml network_info=[{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:50 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:50 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-683695795',display_name='tempest-ServerActionsTestOtherA-server-683695795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-683695795',id=19,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-dfkuque9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=8f79cb9d-3fac-4e13-8f17-5d045e40ab0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:50 user nova-compute[75409]:   <uuid>8f79cb9d-3fac-4e13-8f17-5d045e40ab0e</uuid>
Nov 15 21:29:50 user nova-compute[75409]:   <name>instance-00000013</name>
Nov 15 21:29:50 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:50 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:50 user nova-compute[75409]:   <metadata>
Nov 15 21:29:50 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:50 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherA-server-683695795</nova:name>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:50</nova:creationTime>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:50 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:50 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:user uuid="4ae40e5bccb84c50a4c93963d56469f9">tempest-ServerActionsTestOtherA-1526007087-project-member</nova:user>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:project uuid="a8d130f253b745e2ac2497eebbd4cf99">tempest-ServerActionsTestOtherA-1526007087</nova:project>
Nov 15 21:29:50 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:29:50 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:50 user nova-compute[75409]:         <nova:port uuid="3a5939fb-e818-4bad-92ee-ab635a88cff8">
Nov 15 21:29:50 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:29:50 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:50 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:50 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:50 user nova-compute[75409]:   </metadata>
Nov 15 21:29:50 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:50 user nova-compute[75409]:     <system>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="serial">8f79cb9d-3fac-4e13-8f17-5d045e40ab0e</entry>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="uuid">8f79cb9d-3fac-4e13-8f17-5d045e40ab0e</entry>
Nov 15 21:29:50 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:50 user nova-compute[75409]:     </system>
Nov 15 21:29:50 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:50 user nova-compute[75409]:   <os>
Nov 15 21:29:50 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:50 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:50 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:50 user nova-compute[75409]:   </os>
Nov 15 21:29:50 user nova-compute[75409]:   <features>
Nov 15 21:29:50 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:50 user nova-compute[75409]:     <apic/>
Nov 15 21:29:50 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:50 user nova-compute[75409]:   </features>
Nov 15 21:29:50 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:50 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:50 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:50 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:50 user nova-compute[75409]:   </clock>
Nov 15 21:29:50 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:50 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:50 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:50 user nova-compute[75409]:   </cpu>
Nov 15 21:29:50 user nova-compute[75409]:   <devices>
Nov 15 21:29:50 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:50 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:50 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk"/>
Nov 15 21:29:50 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:29:50 user nova-compute[75409]:     </disk>
Nov 15 21:29:50 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:50 user nova-compute[75409]:       <mac address="fa:16:3e:08:c1:45"/>
Nov 15 21:29:50 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:50 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:50 user nova-compute[75409]:       <target dev="tap3a5939fb-e8"/>
Nov 15 21:29:50 user nova-compute[75409]:     </interface>
Nov 15 21:29:50 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:50 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/console.log" append="off"/>
Nov 15 21:29:50 user nova-compute[75409]:     </serial>
Nov 15 21:29:50 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:50 user nova-compute[75409]:     <video>
Nov 15 21:29:50 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:50 user nova-compute[75409]:     </video>
Nov 15 21:29:50 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:50 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:50 user nova-compute[75409]:     </rng>
Nov 15 21:29:50 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:50 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:50 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:50 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:50 user nova-compute[75409]:   </devices>
Nov 15 21:29:50 user nova-compute[75409]: </domain>
Nov 15 21:29:50 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-683695795',display_name='tempest-ServerActionsTestOtherA-server-683695795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-683695795',id=19,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-dfkuque9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=8f79cb9d-3fac-4e13-8f17-5d045e40ab0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG os_vif [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:50 user nova-compute[75409]: INFO nova.compute.manager [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Took 8.72 seconds to build instance.
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e5f424f-f885-5210-80ab-0b7b91b2617b', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a5939fb-e8, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a5939fb-e8, col_values=(('qos', UUID('55830a5d-3816-478e-a9fc-621f993f342b')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a5939fb-e8, col_values=(('external_ids', {'iface-id': '3a5939fb-e818-4bad-92ee-ab635a88cff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:c1:45', 'vm-uuid': '8f79cb9d-3fac-4e13-8f17-5d045e40ab0e'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3664ad1c-e106-4a5d-bed1-efc42ed17f86 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.857s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:50 user nova-compute[75409]: INFO os_vif [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8')
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:08:c1:45, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.998s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.848s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:29:50 user nova-compute[75409]: INFO nova.compute.claims [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Claim successful on node user
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated VIF entry in instance network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] No waiting events found dispatching network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:51 user nova-compute[75409]: WARNING nova.compute.manager [req-7a901804-b132-4bd6-a359-eb5b629fa946 req-b61f7b38-1c43-4720-9291-1d5ba1a835da service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received unexpected event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 for instance with vm_state building and task_state spawning.
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:29:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.policy [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1dcb2c6a3fc42d08d6af32d01475751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddec4e015c454beea9d9814218dad1c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:29:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Creating image(s)
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "/opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "/opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk 1073741824" returned: 0 in 0.068s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Successfully created port: d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] No waiting events found dispatching network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:52 user nova-compute[75409]: WARNING nova.compute.manager [req-c3f4a42c-62e9-4bc9-8c2d-a7602635589c req-da75eabb-9a63-4849-85c7-790587ac1c74 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received unexpected event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 for instance with vm_state building and task_state spawning.
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Successfully updated port: d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquired lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-changed-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Refreshing instance network info cache due to event network-changed-d3bdf0e2-5778-4821-ab53-c74fbbd298b2. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] Acquiring lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Releasing lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Instance network_info: |[{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] Acquired lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.neutron [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Refreshing network info cache for port d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Start _get_guest_xml network_info=[{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:29:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963848562',display_name='tempest-VolumesAdminNegativeTest-server-963848562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963848562',id=20,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNIiik+ZViBcF6FJecxAsc8I466sXTlq//Ev4r6+dtqR4vT6/ZNraBV6335KiayQTPvXgd7KQz3wCUnyRiLG5uQqSO5x4uxynflAUp+n6xE50xVxoGRFd3nu3s/7231mQ==',key_name='tempest-keypair-1131947064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-wfqoua9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=fc9f1ffc-6dbc-4d16-bc0e-ca453691d378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:29:53 user nova-compute[75409]:   <uuid>fc9f1ffc-6dbc-4d16-bc0e-ca453691d378</uuid>
Nov 15 21:29:53 user nova-compute[75409]:   <name>instance-00000014</name>
Nov 15 21:29:53 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:29:53 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:29:53 user nova-compute[75409]:   <metadata>
Nov 15 21:29:53 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:29:53 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:name>tempest-VolumesAdminNegativeTest-server-963848562</nova:name>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:29:53</nova:creationTime>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:29:53 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:29:53 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:owner>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:user uuid="a1dcb2c6a3fc42d08d6af32d01475751">tempest-VolumesAdminNegativeTest-399086255-project-member</nova:user>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:project uuid="ddec4e015c454beea9d9814218dad1c5">tempest-VolumesAdminNegativeTest-399086255</nova:project>
Nov 15 21:29:53 user nova-compute[75409]:       </nova:owner>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:29:53 user nova-compute[75409]:       <nova:ports>
Nov 15 21:29:53 user nova-compute[75409]:         <nova:port uuid="d3bdf0e2-5778-4821-ab53-c74fbbd298b2">
Nov 15 21:29:53 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:29:53 user nova-compute[75409]:         </nova:port>
Nov 15 21:29:53 user nova-compute[75409]:       </nova:ports>
Nov 15 21:29:53 user nova-compute[75409]:     </nova:instance>
Nov 15 21:29:53 user nova-compute[75409]:   </metadata>
Nov 15 21:29:53 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:29:53 user nova-compute[75409]:     <system>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="serial">fc9f1ffc-6dbc-4d16-bc0e-ca453691d378</entry>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="uuid">fc9f1ffc-6dbc-4d16-bc0e-ca453691d378</entry>
Nov 15 21:29:53 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:29:53 user nova-compute[75409]:     </system>
Nov 15 21:29:53 user nova-compute[75409]:   </sysinfo>
Nov 15 21:29:53 user nova-compute[75409]:   <os>
Nov 15 21:29:53 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:29:53 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:29:53 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:29:53 user nova-compute[75409]:   </os>
Nov 15 21:29:53 user nova-compute[75409]:   <features>
Nov 15 21:29:53 user nova-compute[75409]:     <acpi/>
Nov 15 21:29:53 user nova-compute[75409]:     <apic/>
Nov 15 21:29:53 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:29:53 user nova-compute[75409]:   </features>
Nov 15 21:29:53 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:29:53 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:29:53 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:29:53 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:29:53 user nova-compute[75409]:   </clock>
Nov 15 21:29:53 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:29:53 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:29:53 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:29:53 user nova-compute[75409]:   </cpu>
Nov 15 21:29:53 user nova-compute[75409]:   <devices>
Nov 15 21:29:53 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:29:53 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:29:53 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk"/>
Nov 15 21:29:53 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:29:53 user nova-compute[75409]:     </disk>
Nov 15 21:29:53 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:29:53 user nova-compute[75409]:       <mac address="fa:16:3e:21:73:ec"/>
Nov 15 21:29:53 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:53 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:29:53 user nova-compute[75409]:       <target dev="tapd3bdf0e2-57"/>
Nov 15 21:29:53 user nova-compute[75409]:     </interface>
Nov 15 21:29:53 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:29:53 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/console.log" append="off"/>
Nov 15 21:29:53 user nova-compute[75409]:     </serial>
Nov 15 21:29:53 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:29:53 user nova-compute[75409]:     <video>
Nov 15 21:29:53 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:29:53 user nova-compute[75409]:     </video>
Nov 15 21:29:53 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:29:53 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:29:53 user nova-compute[75409]:     </rng>
Nov 15 21:29:53 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:29:53 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:29:53 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:29:53 user nova-compute[75409]:     </memballoon>
Nov 15 21:29:53 user nova-compute[75409]:   </devices>
Nov 15 21:29:53 user nova-compute[75409]: </domain>
Nov 15 21:29:53 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963848562',display_name='tempest-VolumesAdminNegativeTest-server-963848562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963848562',id=20,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNIiik+ZViBcF6FJecxAsc8I466sXTlq//Ev4r6+dtqR4vT6/ZNraBV6335KiayQTPvXgd7KQz3wCUnyRiLG5uQqSO5x4uxynflAUp+n6xE50xVxoGRFd3nu3s/7231mQ==',key_name='tempest-keypair-1131947064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-wfqoua9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=fc9f1ffc-6dbc-4d16-bc0e-ca453691d378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG os_vif [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c8bcbf-a934-5617-b1f9-7999994dc7ad', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3bdf0e2-57, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3bdf0e2-57, col_values=(('qos', UUID('84455dee-2662-4530-8f9e-bba8f93e14ca')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3bdf0e2-57, col_values=(('external_ids', {'iface-id': 'd3bdf0e2-5778-4821-ab53-c74fbbd298b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:73:ec', 'vm-uuid': 'fc9f1ffc-6dbc-4d16-bc0e-ca453691d378'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:53 user nova-compute[75409]: INFO os_vif [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57')
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No VIF found with MAC fa:16:3e:21:73:ec, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:29:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updated VIF entry in instance network info cache for port d3bdf0e2-5778-4821-ab53-c74fbbd298b2. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-96560fbf-ae02-4d06-b9de-fcfbd0cb5d7c req-bcd263e2-ee5d-46e7-9ca3-0dcaa3103d01 service nova] Releasing lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Instance spawned successfully.
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:54 user nova-compute[75409]: INFO nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Took 9.62 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] No waiting events found dispatching network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:54 user nova-compute[75409]: WARNING nova.compute.manager [req-f3bf01a1-cf08-4776-a9d2-a200384cf14a req-26229054-d47d-466b-8667-6342162d44e1 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received unexpected event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 for instance with vm_state building and task_state spawning.
Nov 15 21:29:54 user nova-compute[75409]: INFO nova.compute.manager [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Took 11.13 seconds to build instance.
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8f724f26-59c1-43d8-9ed2-f2aba64348ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.267s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-changed-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing instance network info cache due to event network-changed-17025d39-395d-4ca8-bb67-c699ebc1057a. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] Acquiring lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] Acquired lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:29:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Refreshing network info cache for port 17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updated VIF entry in instance network info cache for port 17025d39-395d-4ca8-bb67-c699ebc1057a. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:29:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-06ccadf8-ffae-42b8-ba67-062a371d34e0 req-17bf4a80-32f1-401c-9d2a-693bf9047b69 service nova] Releasing lock "refresh_cache-2768ee6d-1fca-48de-ba3c-23238efcb0eb" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] No waiting events found dispatching network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:56 user nova-compute[75409]: WARNING nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received unexpected event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 for instance with vm_state building and task_state spawning.
Nov 15 21:29:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] No waiting events found dispatching network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:56 user nova-compute[75409]: WARNING nova.compute.manager [req-2a6df638-04e3-465d-b837-90dbca12c282 req-886e6727-0857-4398-bad7-a4ee024ceb4b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received unexpected event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 for instance with vm_state building and task_state spawning.
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:57 user nova-compute[75409]: INFO nova.compute.manager [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Terminating instance
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:29:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Instance spawned successfully.
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: INFO nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: INFO nova.compute.manager [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Took 7.73 seconds to build instance.
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b7b6c250-e183-42ba-9e39-33cf89db1f78 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.846s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-48ff2489-020d-4eb2-a95a-1563ddcd51ff req-91b96837-1181-4076-99c6-eb8eeb43b059 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-6290b0b3-1556-494e-81ef-31fb53e9d63c for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-45fc1b05-1a29-40ec-a57e-569a9f2ee0b9 req-10e68e8c-5307-4391-a9ee-bbece9f3f41c service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-17025d39-395d-4ca8-bb67-c699ebc1057a for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:58 user nova-compute[75409]: WARNING nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-17025d39-395d-4ca8-bb67-c699ebc1057a for instance with vm_state active and task_state deleting.
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:29:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:29:58 user nova-compute[75409]: WARNING nova.compute.manager [req-7600c152-441d-4f36-8b08-31604779d10b req-fb6bd4f4-ec34-47c6-bea0-4bc63cc40c8d service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-fd413390-1be6-4f9c-9f2b-b906f60684e6 for instance with vm_state active and task_state deleting.
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Instance destroyed successfully.
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lazy-loading 'resources' on Instance uuid 2768ee6d-1fca-48de-ba3c-23238efcb0eb {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17025d39-39, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=655d9568-d9e9-4196-bfc6-0c5d96ded277) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:ad:1d,bridge_name='br-int',has_traffic_filtering=True,id=17025d39-395d-4ca8-bb67-c699ebc1057a,network=Network(95bcf7e9-8e02-44f5-95fc-754c2b3e1729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17025d39-39')
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6290b0b3-15, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71bdffb7-65b0-4fd7-9ec6-ae1d98375d10) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:29,bridge_name='br-int',has_traffic_filtering=True,id=6290b0b3-1556-494e-81ef-31fb53e9d63c,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6290b0b3-15')
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd413390-1b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0596b330-39eb-4ff5-9a0e-b5e059160d6c) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-6290b0b3-1556-494e-81ef-31fb53e9d63c for instance with vm_state active and task_state deleting.
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-b333783f-0f20-4a55-bb91-82b75e35a4a3 for instance with vm_state active and task_state deleting.
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-c66a1a3c-c623-4d53-9790-13b5414254b9 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING nova.compute.manager [req-f3f9f4a2-510f-410a-b918-3e95277a4e2d req-e1d86018-effb-48ba-9fcc-4024d78dbb2e service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-c66a1a3c-c623-4d53-9790-13b5414254b9 for instance with vm_state active and task_state deleting.
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:40:0a,bridge_name='br-int',has_traffic_filtering=True,id=fd413390-1be6-4f9c-9f2b-b906f60684e6,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd413390-1b')
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "address": "fa:16:3e:d7:56:9f", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1afa9685-d3", "ovs_interfaceid": "1afa9685-d317-44b6-90d7-8ce4ac3c4836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1afa9685-d3, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=014857f8-0d3b-4228-89d9-6fcd267f25d6) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:56:9f,bridge_name='br-int',has_traffic_filtering=True,id=1afa9685-d317-44b6-90d7-8ce4ac3c4836,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1afa9685-d3')
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd57340c2-9b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7184cfc3-1030-4d9f-91e2-7dbe6496629b) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:9b:5d,bridge_name='br-int',has_traffic_filtering=True,id=d57340c2-9b2d-4191-95c0-7cb6052918db,network=Network(3734be99-34fb-4b33-afef-2bfd66a53ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57340c2-9b')
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb333783f-0f, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccf2fd75-1ad2-4579-bddf-5e6155266e38) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0e:2d,bridge_name='br-int',has_traffic_filtering=True,id=b333783f-0f20-4a55-bb91-82b75e35a4a3,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb333783f-0f')
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:28:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-558204565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-558204565',id=13,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ1aaBbYFVamJVF33XzbogKtft5qxWJiWcW/Hd4ZkeoNkZ2k9D8hzyYDm6xFBaitIwDMlG1zDRGKzXgq3USVI0aoRGw9GNOfB0zFUYEWiFhLRWlGVUEcEYFxiJMpQvXDg==',key_name='tempest-keypair-1892050521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c12e41bbcd4659bb3048fa8ed720a2',ramdisk_id='',reservation_id='r-z6akgj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1476863537',owner_user_name='tempest-TaggedBootDevicesTest-1476863537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da430eb1ac4ffbb3e400b7f71c99a1',uuid=2768ee6d-1fca-48de-ba3c-23238efcb0eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converting VIF {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66a1a3c-c6, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eba975e0-8bdf-4124-af75-ddbc9a39dab3) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:00 user nova-compute[75409]: INFO os_vif [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:75:1e,bridge_name='br-int',has_traffic_filtering=True,id=c66a1a3c-c623-4d53-9790-13b5414254b9,network=Network(a495b1f1-50c9-433b-8204-c867e05c7686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66a1a3c-c6')
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xunJZYcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978a448-3d6c-47cd-a9a4-0cc9a2def56f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]: iSNS:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]: STATIC:
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: FIRMWARE:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:30:00 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:30:00 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf356b8-2ef7-409c-b52f-79e8472b622b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aa8531-41ee-4903-8065-5d4cc1cc4c2e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-1afa9685-d317-44b6-90d7-8ce4ac3c4836 for instance with vm_state active and task_state deleting.
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-unplugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-unplugged-d57340c2-9b2d-4191-95c0-7cb6052918db for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Acquiring lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] No waiting events found dispatching network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING nova.compute.manager [req-a84d564b-92d5-4fc9-84f7-f643cd9b13d8 req-75d7bf3d-9867-49c5-b383-881819e3711a service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received unexpected event network-vif-plugged-d57340c2-9b2d-4191-95c0-7cb6052918db for instance with vm_state active and task_state deleting.
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ea004-b2d1-4622-97b0-1a1518d6e588]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b85db-6a2d-416d-8d33-82e8a40b26da]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4026e386-4501-47d4-b63e-5af082b3cbd2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc622cde-5320-4a51-8fda-e028aa3b009a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d330b3aa-cccd-4f15-8dd6-1e57ebbf541a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e7a795-4f51-40d5-b147-04522bcecceb]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260]
Nov 15 21:30:00 user nova-compute[75409]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff, portal: 172.16.0.220,3260] successful.
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff48553-b5b5-425e-8929-2a79996842ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b381fd4-3aa0-44d3-b3d9-ac7b507e4db3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== disconnect_volume: return (390ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHrokdRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:30:00 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493b9e5-c128-4bd1-a045-fb4bdaf28a44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]: iSNS:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]: STATIC:
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:30:00 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:00 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:00 user nova-compute[75409]: FIRMWARE:
Nov 15 21:30:00 user nova-compute[75409]: No targets found.
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:30:00 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:30:00 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce2235-4ca5-469a-b31d-e28c9818a890]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42dd2a-f286-4874-ba93-815f65d8e34b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59036fd-38e0-42be-aa86-09378c34df14]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b7b53-8417-43b1-ba1d-4920cb134ee8]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd5578-f908-4e6f-9dcc-633f969354db]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[686badab-7fea-466a-a40a-a2a05403c8c7]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c116236-33bb-4aed-9995-44cffdcd76fa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[986f1015-dd56-4bde-8118-ec1750e61341]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260]
Nov 15 21:30:00 user nova-compute[75409]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9, portal: 172.16.0.220,3260] successful.
Nov 15 21:30:00 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ae221ef-b4ff-4657-b565-3e0af5e824b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcce15b-ffc5-4063-a0cf-8def01d46a19]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== disconnect_volume: return (315ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJGdmIjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:30:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d011a-df68-4b66-bfaf-977962ab4df6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:30:01 user nova-compute[75409]: No targets found.
Nov 15 21:30:01 user nova-compute[75409]: iSNS:
Nov 15 21:30:01 user nova-compute[75409]: No targets found.
Nov 15 21:30:01 user nova-compute[75409]: STATIC:
Nov 15 21:30:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:30:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974
Nov 15 21:30:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:30:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:01 user nova-compute[75409]: FIRMWARE:
Nov 15 21:30:01 user nova-compute[75409]: No targets found.
Nov 15 21:30:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:30:01 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:30:01 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8d780-825a-4fa5-a468-a68aa1d4014d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c72f3-bdbf-4d51-a6ab-a0e17adce38e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974'): ({'sdg'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Removing single pathed devices sdg {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04544f34-130c-4911-bb1c-2ac096facea2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fb82c-d41a-48a1-b70f-4cd5e7e1a6cb]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Flushing IO for device /dev/sdg {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db6ca9b-3b2e-45d9-936c-9ad5f043e797]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5802d6-cb85-4df3-8b4b-645d554d9e98]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] SCSI volumes sdg have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b866db-1308-45f3-821a-1603c2c2c2ab]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13f58c-f938-4147-b0e9-e0e776306ecc]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260]
Nov 15 21:30:01 user nova-compute[75409]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974, portal: 172.16.0.220,3260] successful.
Nov 15 21:30:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7205a9b1-58f2-4f73-86fb-915cbc6b4974 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5737c11d-9a2e-4840-bfaa-d8df741ded80]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] <== disconnect_volume: return (317ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:30:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Deleting instance files /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb_del
Nov 15 21:30:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Deletion of /opt/stack/data/nova/instances/2768ee6d-1fca-48de-ba3c-23238efcb0eb_del complete
Nov 15 21:30:01 user nova-compute[75409]: INFO nova.compute.manager [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Took 3.94 seconds to destroy the instance on the hypervisor.
Nov 15 21:30:01 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:30:01 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:30:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-37596705-c12d-4840-9bea-206d5d916af4 req-e6da6dd1-ed17-45f7-82a3-ffcd4f484ac1 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-deleted-1afa9685-d317-44b6-90d7-8ce4ac3c4836 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:03 user nova-compute[75409]: INFO nova.compute.manager [req-37596705-c12d-4840-9bea-206d5d916af4 req-e6da6dd1-ed17-45f7-82a3-ffcd4f484ac1 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Neutron deleted interface 1afa9685-d317-44b6-90d7-8ce4ac3c4836; detaching it from the instance and deleting it from the info cache
Nov 15 21:30:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-37596705-c12d-4840-9bea-206d5d916af4 req-e6da6dd1-ed17-45f7-82a3-ffcd4f484ac1 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [{"id": "17025d39-395d-4ca8-bb67-c699ebc1057a", "address": "fa:16:3e:0c:ad:1d", "network": {"id": "95bcf7e9-8e02-44f5-95fc-754c2b3e1729", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-293807022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17025d39-39", "ovs_interfaceid": "17025d39-395d-4ca8-bb67-c699ebc1057a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "address": "fa:16:3e:95:11:29", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6290b0b3-15", "ovs_interfaceid": "6290b0b3-1556-494e-81ef-31fb53e9d63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "address": "fa:16:3e:ad:40:0a", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd413390-1b", "ovs_interfaceid": "fd413390-1be6-4f9c-9f2b-b906f60684e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d57340c2-9b2d-4191-95c0-7cb6052918db", "address": "fa:16:3e:67:9b:5d", "network": {"id": "3734be99-34fb-4b33-afef-2bfd66a53ca6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1927887745", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57340c2-9b", "ovs_interfaceid": "d57340c2-9b2d-4191-95c0-7cb6052918db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "address": "fa:16:3e:62:0e:2d", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb333783f-0f", "ovs_interfaceid": "b333783f-0f20-4a55-bb91-82b75e35a4a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c66a1a3c-c623-4d53-9790-13b5414254b9", "address": "fa:16:3e:ce:75:1e", "network": {"id": "a495b1f1-50c9-433b-8204-c867e05c7686", "bridge": "br-int", "label": "tempest-device-tagging-net2-986896592", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8c12e41bbcd4659bb3048fa8ed720a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66a1a3c-c6", "ovs_interfaceid": "c66a1a3c-c623-4d53-9790-13b5414254b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-37596705-c12d-4840-9bea-206d5d916af4 req-e6da6dd1-ed17-45f7-82a3-ffcd4f484ac1 service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Detach interface failed, port_id=1afa9685-d317-44b6-90d7-8ce4ac3c4836, reason: Instance 2768ee6d-1fca-48de-ba3c-23238efcb0eb could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:30:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:05 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:05 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Took 3.64 seconds to deallocate network for instance.
Nov 15 21:30:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-53fb84e2-bba4-4924-9d66-ab45535a513e req-effac216-831d-4066-b666-06e00b30e8cf service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-deleted-c66a1a3c-c623-4d53-9790-13b5414254b9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-53fb84e2-bba4-4924-9d66-ab45535a513e req-effac216-831d-4066-b666-06e00b30e8cf service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-deleted-17025d39-395d-4ca8-bb67-c699ebc1057a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-53fb84e2-bba4-4924-9d66-ab45535a513e req-effac216-831d-4066-b666-06e00b30e8cf service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-deleted-d57340c2-9b2d-4191-95c0-7cb6052918db {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-53fb84e2-bba4-4924-9d66-ab45535a513e req-effac216-831d-4066-b666-06e00b30e8cf service nova] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Received event network-vif-deleted-b333783f-0f20-4a55-bb91-82b75e35a4a3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:07 user nova-compute[75409]: INFO nova.compute.manager [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] [instance: 2768ee6d-1fca-48de-ba3c-23238efcb0eb] Took 2.39 seconds to detach 3 volumes for instance.
Nov 15 21:30:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:07 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:30:07 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:30:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:07 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Deleted allocations for instance 2768ee6d-1fca-48de-ba3c-23238efcb0eb
Nov 15 21:30:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a9da6898-9672-4d95-868b-b5a8a0477c83 tempest-TaggedBootDevicesTest-1476863537 tempest-TaggedBootDevicesTest-1476863537-project-member] Lock "2768ee6d-1fca-48de-ba3c-23238efcb0eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.533s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:15 user nova-compute[75409]: INFO nova.compute.manager [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Terminating instance
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-ded69ecb-b4ad-4e82-8106-67369049ec05 req-2bf30e8a-4520-45e2-9841-b7697d9459cd service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-unplugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:30:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Instance destroyed successfully.
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'resources' on Instance uuid bac6908e-d641-439c-bb4c-8a86352bb9d9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1600133315',display_name='tempest-TestMinimumBasicScenario-server-1600133315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1600133315',id=7,image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3xr/UsAigkHXR9J/jbjGo7CEtAYHmPhNPfrREvNEDTetep8A/PeZQcduDMJRs0xt9UHi8ceqtqqWhoU2ZhUYsjkQ4WvpgMvQq5FOdYFj78l4ryJK5swZg52AOc9uJXEQ==',key_name='tempest-TestMinimumBasicScenario-279921062',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-y2pf2dy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eebd53c3-6230-49d5-8153-61b25b39b74f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:27:36Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=bac6908e-d641-439c-bb4c-8a86352bb9d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "address": "fa:16:3e:b8:6a:ed", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6464f2cb-6c", "ovs_interfaceid": "6464f2cb-6c06-4c15-ab77-8887d3e29593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG os_vif [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6464f2cb-6c, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dd83800-aa1b-4902-9b68-af2c4f373863) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:15 user nova-compute[75409]: INFO os_vif [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:6a:ed,bridge_name='br-int',has_traffic_filtering=True,id=6464f2cb-6c06-4c15-ab77-8887d3e29593,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6464f2cb-6c')
Nov 15 21:30:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Deleting instance files /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9_del
Nov 15 21:30:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Deletion of /opt/stack/data/nova/instances/bac6908e-d641-439c-bb4c-8a86352bb9d9_del complete
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.compute.manager [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.compute.manager [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Detaching volume cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.virt.block_device [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Attempting to driver detach volume cc061491-adc2-4e48-80db-c8fb4cfb4e32 from mountpoint /dev/vdc
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Attempting to detach device vdc from instance 77ef017e-9905-491a-9def-b81e289ac07b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:30:16 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:30:16 user nova-compute[75409]:   <source dev="/dev/sdh"/>
Nov 15 21:30:16 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:30:16 user nova-compute[75409]:   <serial>cc061491-adc2-4e48-80db-c8fb4cfb4e32</serial>
Nov 15 21:30:16 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:30:16 user nova-compute[75409]: </disk>
Nov 15 21:30:16 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully detached device vdc from instance 77ef017e-9905-491a-9def-b81e289ac07b from the persistent domain config.
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 77ef017e-9905-491a-9def-b81e289ac07b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:30:16 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:30:16 user nova-compute[75409]:   <source dev="/dev/sdh"/>
Nov 15 21:30:16 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:30:16 user nova-compute[75409]:   <serial>cc061491-adc2-4e48-80db-c8fb4cfb4e32</serial>
Nov 15 21:30:16 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:30:16 user nova-compute[75409]: </disk>
Nov 15 21:30:16 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Took 0.40 seconds to deallocate network for instance.
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:30:16 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Deleted allocations for instance bac6908e-d641-439c-bb4c-8a86352bb9d9
Nov 15 21:30:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2da7a363-3ce1-48af-a233-162d5366c212 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] Acquiring lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] Lock "bac6908e-d641-439c-bb4c-8a86352bb9d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] No waiting events found dispatching network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:17 user nova-compute[75409]: WARNING nova.compute.manager [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received unexpected event network-vif-plugged-6464f2cb-6c06-4c15-ab77-8887d3e29593 for instance with vm_state deleted and task_state None.
Nov 15 21:30:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-07c70fb1-53b9-4676-8ff3-f5fe1580dc47 req-96688bd4-54fb-4664-8135-ade325f21a4a service nova] [instance: bac6908e-d641-439c-bb4c-8a86352bb9d9] Received event network-vif-deleted-6464f2cb-6c06-4c15-ab77-8887d3e29593 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:30:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:30:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:31 user nova-compute[75409]: INFO nova.compute.manager [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Unrescuing
Nov 15 21:30:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'flavor' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:32 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance destroyed successfully.
Nov 15 21:30:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:32 user nova-compute[75409]: WARNING nova.compute.manager [req-0b19331c-f504-48e4-8bfc-7535914390f7 req-6612bf99-8dba-4d87-8350-f9e95916b63c service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:30:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:34 user nova-compute[75409]: INFO nova.compute.manager [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Terminating instance
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:34 user nova-compute[75409]: WARNING nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing instance network info cache due to event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-unplugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] No waiting events found dispatching network-vif-unplugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-b83b2c7b-4d16-4696-bf62-1522d1ff0415 req-915ff3c8-cd88-4e56-8570-45883846d1ce service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-unplugged-3da23f80-c159-45e8-86be-496fbca82ab6 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:30:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Instance destroyed successfully.
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lazy-loading 'resources' on Instance uuid ad612188-0e18-450b-ba0e-41b3d8e26016 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616068173',display_name='tempest-VolumesActionsTest-instance-616068173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616068173',id=14,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a7db8991da84139a8cf85771d3ec173',ramdisk_id='',reservation_id='r-flwy85x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1907874876',owner_user_name='tempest-VolumesActionsTest-1907874876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:52Z,user_data=None,user_id='da1a39965eca49a3968d2f663ee23456',uuid=ad612188-0e18-450b-ba0e-41b3d8e26016,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converting VIF {"id": "3da23f80-c159-45e8-86be-496fbca82ab6", "address": "fa:16:3e:52:25:55", "network": {"id": "6c628ac6-d769-4493-b526-217fc3dafd03", "bridge": "br-int", "label": "tempest-VolumesActionsTest-327415184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a7db8991da84139a8cf85771d3ec173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da23f80-c1", "ovs_interfaceid": "3da23f80-c159-45e8-86be-496fbca82ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG os_vif [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3da23f80-c1, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71eb0e8e-2b4a-46b5-824a-e51e1d49851f) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:30:35 user nova-compute[75409]: INFO os_vif [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:25:55,bridge_name='br-int',has_traffic_filtering=True,id=3da23f80-c159-45e8-86be-496fbca82ab6,network=Network(6c628ac6-d769-4493-b526-217fc3dafd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da23f80-c1')
Nov 15 21:30:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Deleting instance files /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016_del
Nov 15 21:30:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Deletion of /opt/stack/data/nova/instances/ad612188-0e18-450b-ba0e-41b3d8e26016_del complete
Nov 15 21:30:35 user nova-compute[75409]: INFO nova.compute.manager [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated VIF entry in instance network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing instance network info cache due to event network-changed-35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:30:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Refreshing network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:36 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Took 0.77 seconds to deallocate network for instance.
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-33b481dc-6009-4a0a-91c2-a4335dafe642 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated VIF entry in instance network info cache for port 35d82c8f-3046-4e3b-85ba-ba91853e4cb5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:36 user nova-compute[75409]: WARNING nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:36 user nova-compute[75409]: WARNING nova.compute.manager [req-43a47f53-f8ca-4f3e-b2fe-f088d50e28ec req-76bd5397-1d37-4e11-b42d-4df08220175d service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:36 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Deleted allocations for instance ad612188-0e18-450b-ba0e-41b3d8e26016
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-70631998-bb56-489c-b802-d08850118b8f tempest-VolumesActionsTest-1907874876 tempest-VolumesActionsTest-1907874876-project-member] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 77ef017e-9905-491a-9def-b81e289ac07b is timed out.
Nov 15 21:30:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully detached device vdc from instance 77ef017e-9905-491a-9def-b81e289ac07b from the live domain config.
Nov 15 21:30:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsWCuVOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:30:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b699f-0f06-4e9b-a057-60817067ee98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:30:36 user nova-compute[75409]: No targets found.
Nov 15 21:30:36 user nova-compute[75409]: iSNS:
Nov 15 21:30:36 user nova-compute[75409]: No targets found.
Nov 15 21:30:36 user nova-compute[75409]: STATIC:
Nov 15 21:30:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:30:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32
Nov 15 21:30:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:30:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:30:36 user nova-compute[75409]: FIRMWARE:
Nov 15 21:30:36 user nova-compute[75409]: No targets found.
Nov 15 21:30:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:30:36 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:30:36 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb96637-47e4-4139-9729-58b5a4844b02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[911efc59-9583-4411-8e3f-d25fed51cc80]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:36 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:30:36 user nova-compute[75409]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 (non-flash)
Nov 15 21:30:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32'): ({'sdh'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Removing single pathed devices sdh {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a834e25-577a-4d0e-818f-97fb3e4d40ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e9900-effb-4a01-979c-80249b859238]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flushing IO for device /dev/sdh {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:30:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8fe3bc-b61f-41d6-985d-db01cd90d7a9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64454e22-889e-46e0-96df-899cba618c97]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] SCSI volumes sdh have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] Acquiring lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] Lock "ad612188-0e18-450b-ba0e-41b3d8e26016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] No waiting events found dispatching network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:30:37 user nova-compute[75409]: WARNING nova.compute.manager [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received unexpected event network-vif-plugged-3da23f80-c159-45e8-86be-496fbca82ab6 for instance with vm_state deleted and task_state None.
Nov 15 21:30:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-9d4b572e-6696-43a0-b09f-398a4de4fdc4 req-9ce9d361-7261-40db-b08c-1f347699a926 service nova] [instance: ad612188-0e18-450b-ba0e-41b3d8e26016] Received event network-vif-deleted-3da23f80-c159-45e8-86be-496fbca82ab6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c2bfc3-630a-4166-8520-63843929b97e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9370c8-9c40-4e2f-a5a6-f2e1eefc8716]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260]
Nov 15 21:30:37 user nova-compute[75409]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32, portal: 172.16.0.220,3260] successful.
Nov 15 21:30:37 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc061491-adc2-4e48-80db-c8fb4cfb4e32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003f926-7207-44ea-8948-3b54c48f7728]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] <== disconnect_volume: return (329ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'flavor' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1ba31d94-7421-4f35-a8d8-b69547949adb tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [{"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:30:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:30:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:30:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:30:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7503MB free_disk=25.098342895507812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77ef017e-9905-491a-9def-b81e289ac07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance cd3765d7-3e52-4478-9c46-4aea89707638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 4053527e-16c3-436b-916f-9d7ca3d2a11c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c63d2f15-9011-4d63-80ff-989cee557e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:30:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.806s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:30:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-changed-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Refreshing instance network info cache due to event network-changed-41267a36-8581-4112-9fb3-6ab7b641c7a0. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] Acquiring lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] Acquired lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Refreshing network info cache for port 41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updated VIF entry in instance network info cache for port 41267a36-8581-4112-9fb3-6ab7b641c7a0. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff537a94-6bde-4094-8a00-8adbdde1a3c6 req-e4b870cd-3a23-4eed-a08b-019849b21808 service nova] Releasing lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-changed-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Refreshing instance network info cache due to event network-changed-2c9dd991-6743-45f3-af24-cd08422d3843. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Refreshing network info cache for port 2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updated VIF entry in instance network info cache for port 2c9dd991-6743-45f3-af24-cd08422d3843. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ec722ea7-198e-4777-be31-e7246d7b2412 req-5b259fba-199b-46b7-b6f6-9f45cd3e5a51 service nova] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lazy-loading 'flavor' on Instance uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:03 user nova-compute[75409]: INFO nova.compute.manager [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Attaching volume 4d517379-a4b0-4991-99cd-9b19a11adb7e to /dev/vdb
Nov 15 21:31:03 user nova-compute[75409]: DEBUG os_brick.utils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84480a3f-3b83-49a4-bcab-04b57018ea2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084bbd9-9c68-4345-addb-fdc7b07f3285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0042563-7b1f-4728-862f-1472441e4f63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99173a12-38c4-4e96-806a-a5024a0dd887]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:31:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f61199-4e69-45e5-a25c-c62f1547a45b]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating existing volume attachment record: bd1a5e6b-81af-49f9-a4f2-aaf3af13118a {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG nova.objects.instance [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Ignoring supplied device name: /dev/vdb
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:04 user nova-compute[75409]: INFO nova.compute.manager [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Attaching volume 90b0e768-6889-4992-9dc2-9e3ae82a0498 to /dev/vdb
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3126fc-bf7e-48db-b56d-d3064f9a7f20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffa71a9-4f60-4139-a507-8d6b4ad105bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e4501-8b20-4269-9f9a-41eb04fb8018]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[db29f4b9-3f15-4f4d-9253-14a1e7aa7917]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:31:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705fd7b-7996-451c-bd66-d5f29c7c5831]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:04 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updating existing volume attachment record: 54897036-4bba-443e-b7d1-c5fe1920bc01 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-changed-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Refreshing instance network info cache due to event network-changed-69936157-ea9c-4bd6-8ad9-42df18e567be. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] Acquiring lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] Acquired lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Refreshing network info cache for port 69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updated VIF entry in instance network info cache for port 69936157-ea9c-4bd6-8ad9-42df18e567be. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updating instance_info_cache with network_info: [{"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:05 user nova-compute[75409]: INFO nova.compute.manager [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Detaching volume f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:31:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33be597a-4e69-4497-baa9-cb89111b56ab req-8a768384-32fb-4577-91ad-0a999c90545d service nova] Releasing lock "refresh_cache-4053527e-16c3-436b-916f-9d7ca3d2a11c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:05 user nova-compute[75409]: INFO nova.virt.block_device [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Attempting to driver detach volume f0db07f5-a51b-48cf-9842-0c6f1cd573e0 from mountpoint /dev/vdb
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Attempting to detach device vdb from instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:05 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:05 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:31:05 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:05 user nova-compute[75409]:   <serial>f0db07f5-a51b-48cf-9842-0c6f1cd573e0</serial>
Nov 15 21:31:05 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:05 user nova-compute[75409]: </disk>
Nov 15 21:31:05 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Successfully detached device vdb from instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a from the persistent domain config.
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:31:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:05 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:05 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:31:05 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:05 user nova-compute[75409]:   <serial>f0db07f5-a51b-48cf-9842-0c6f1cd573e0</serial>
Nov 15 21:31:05 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:05 user nova-compute[75409]: </disk>
Nov 15 21:31:05 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:06 user nova-compute[75409]: INFO nova.compute.manager [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Terminating instance
Nov 15 21:31:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-e593b1c4-09cb-4eac-b473-06676b29e8f2 req-a140821c-19d8-4b5a-8424-a02955a4883b service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Instance destroyed successfully.
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'resources' on Instance uuid 77ef017e-9905-491a-9def-b81e289ac07b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1521868239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1521868239',id=2,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvhddLOARROj0AE+nWXziseLRd++fgTkb1aARPcvoXOTf1W6vh8nbbCd7hGGt6F4fpgez+/iZ9ovxv2kLP5GxxnHe0IWvqGdnBCRQJB7B6nApL+59XsaiwyQgBrkG/yLQ==',key_name='tempest-keypair-289692261',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-mhbwy0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77ef017e-9905-491a-9def-b81e289ac07b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "d098b838-c6bc-49e1-9021-293a1b527c93", "address": "fa:16:3e:c5:59:0d", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd098b838-c6", "ovs_interfaceid": "d098b838-c6bc-49e1-9021-293a1b527c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG os_vif [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd098b838-c6, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3027647-73b8-4a0f-b74a-96c306059912) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: INFO os_vif [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:59:0d,bridge_name='br-int',has_traffic_filtering=True,id=d098b838-c6bc-49e1-9021-293a1b527c93,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd098b838-c6')
Nov 15 21:31:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Deleting instance files /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b_del
Nov 15 21:31:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Deletion of /opt/stack/data/nova/instances/77ef017e-9905-491a-9def-b81e289ac07b_del complete
Nov 15 21:31:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:07 user nova-compute[75409]: INFO nova.compute.manager [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 15 21:31:07 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:31:07 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:08 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Took 1.04 seconds to deallocate network for instance.
Nov 15 21:31:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-7549a7fc-f236-4364-a05c-7b0507419aa5 req-fe3825ae-1ea9-41ad-a13b-73538f89d788 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-deleted-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state deleted and task_state None.
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state deleted and task_state None.
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state deleted and task_state None.
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-unplugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state deleted and task_state None.
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Acquiring lock "77ef017e-9905-491a-9def-b81e289ac07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] Lock "77ef017e-9905-491a-9def-b81e289ac07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] No waiting events found dispatching network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING nova.compute.manager [req-845aeff5-6a58-4594-a16d-93418633c5ee req-59b63835-8c7b-4a52-b890-74097a44aca4 service nova] [instance: 77ef017e-9905-491a-9def-b81e289ac07b] Received unexpected event network-vif-plugged-d098b838-c6bc-49e1-9021-293a1b527c93 for instance with vm_state deleted and task_state None.
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Deleted allocations for instance 77ef017e-9905-491a-9def-b81e289ac07b
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCasJtDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:09 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5664dcf-ea38-4681-81a0-384e9ab8dfea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:31:09 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eedbd6-6800-4114-9ac0-6f8112566ef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e] added
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7955d781-2638-4c4e-9cb3-c9b11f30fd97 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77ef017e-9905-491a-9def-b81e289ac07b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61c534-524c-477a-8897-0cf2b3a9db1a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf02b7-b341-4946-ba24-5cd74d0a9cb9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCasJtDO {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCasJtDO" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6727f5b-f73d-48f4-bc86-bdf03ddc7f93]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rCasJtDO'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2853bb51-0856-4f72-9287-6fb7c13eed53]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61e30b-9d1c-4ffa-80c4-dbd0620d04ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76769c28-acbb-4dba-ba4f-4ebcfbdea72e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260]
Nov 15 21:31:09 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59903a25-abfd-4d05-a360-c2b6b728ec6d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1bb2aa-b81e-4a0b-9937-97bc9e2d905e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:09 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:09 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLxDfPZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c17ab-fb51-4f96-b768-98725fd604f2]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:31:09 user nova-compute[75409]: INFO nova.compute.claims [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Claim successful on node user
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:31:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.policy [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2612ed7971eb4b28966e02093c1eceeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7535d0ebae4485c9252ad6909720f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:31:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Creating image(s)
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "/opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "/opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCasJtDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26535353063626539', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535353063626539', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.517s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:11 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:11 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Successfully created port: 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e728a04-edfa-4085-bcac-c070a61599d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:31:11 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lazy-loading 'flavor' on Instance uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[940af67c-73eb-497a-a652-30c05c9c60ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498] added
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:31:11 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:11 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:11 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:11 user nova-compute[75409]:   <serial>4d517379-a4b0-4991-99cd-9b19a11adb7e</serial>
Nov 15 21:31:11 user nova-compute[75409]: </disk>
Nov 15 21:31:11 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fac24c-e73d-415b-8bf2-6dba90703b99]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149e6f3-c451-4c22-acc0-3404f0ec926e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLxDfPZv {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLxDfPZv" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb91c43-034a-47c4-bdb6-07d8d6884a2d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLxDfPZv'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.virt.images [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ced994b9-9b06-40e3-a7c6-457d24240eb8 was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.part /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5304fc-5f59-451b-9499-210ff55d8f6f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016685c-295a-4b8a-beab-19442b8022c2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b82ec7-2081-4cfb-a976-9a093b942ae7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260]
Nov 15 21:31:11 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed2516-0e2d-4827-82ea-e1f797ff939b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37628c-6026-4378-bde7-3c2cc7245b9c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:11 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:11 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a394ca-e1f7-4e2f-a151-605ca68265a0]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.part /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.converted" returned: 0 in 0.282s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] No VIF found with MAC fa:16:3e:3a:0a:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.204s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Successfully updated port: 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-changed-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing instance network info cache due to event network-changed-7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8dcdde68-ba9e-46c0-bc76-c29a65c00eba tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.916s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93,backing_fmt=raw /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93,backing_fmt=raw /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk 1073741824" returned: 0 in 0.046s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance network_info: |[{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing network info cache for port 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLxDfPZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== connect_volume: return (2890ms) {'type': 'block', 'scsi_wwn': '23866333037313534', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866333037313534', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.objects.instance [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:31:12 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:12 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:12 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:12 user nova-compute[75409]:   <serial>90b0e768-6889-4992-9dc2-9e3ae82a0498</serial>
Nov 15 21:31:12 user nova-compute[75409]: </disk>
Nov 15 21:31:12 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Cannot resize image /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Ensure instance console log exists: /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Start _get_guest_xml network_info=[{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:31:06Z,direct_url=<?>,disk_format='qcow2',id=ced994b9-9b06-40e3-a7c6-457d24240eb8,min_disk=0,min_ram=0,name='tempest-scenario-img--171036322',owner='e7535d0ebae4485c9252ad6909720f5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:31:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'ced994b9-9b06-40e3-a7c6-457d24240eb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:31:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:31:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:31:06Z,direct_url=<?>,disk_format='qcow2',id=ced994b9-9b06-40e3-a7c6-457d24240eb8,min_disk=0,min_ram=0,name='tempest-scenario-img--171036322',owner='e7535d0ebae4485c9252ad6909720f5f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:31:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-835053123',display_name='tempest-TestMinimumBasicScenario-server-835053123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-835053123',id=21,image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8TftujJxjBKxpzp2DVN3z6XO3dC/8H6HydHNNYLdsQlDXsiY+zdRKu4Enz/C2gJrwfapnr+ORMNOu1IAnjqGErYS5RYIIH9qOxZ7FtiHIt4EAV9DtJq1QjnS66mTABw==',key_name='tempest-TestMinimumBasicScenario-949963114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-wq0hhobb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:31:10Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=dd6c324b-f505-4391-813d-1534b5ed11ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.objects.instance [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'pci_devices' on Instance uuid dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:31:12 user nova-compute[75409]:   <uuid>dd6c324b-f505-4391-813d-1534b5ed11ec</uuid>
Nov 15 21:31:12 user nova-compute[75409]:   <name>instance-00000015</name>
Nov 15 21:31:12 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:31:12 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:31:12 user nova-compute[75409]:   <metadata>
Nov 15 21:31:12 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:31:12 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:name>tempest-TestMinimumBasicScenario-server-835053123</nova:name>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:31:12</nova:creationTime>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:31:12 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:31:12 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:owner>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:user uuid="2612ed7971eb4b28966e02093c1eceeb">tempest-TestMinimumBasicScenario-998083421-project-member</nova:user>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:project uuid="e7535d0ebae4485c9252ad6909720f5f">tempest-TestMinimumBasicScenario-998083421</nova:project>
Nov 15 21:31:12 user nova-compute[75409]:       </nova:owner>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:root type="image" uuid="ced994b9-9b06-40e3-a7c6-457d24240eb8"/>
Nov 15 21:31:12 user nova-compute[75409]:       <nova:ports>
Nov 15 21:31:12 user nova-compute[75409]:         <nova:port uuid="7932a890-2f96-458d-b5dd-35159892f143">
Nov 15 21:31:12 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:31:12 user nova-compute[75409]:         </nova:port>
Nov 15 21:31:12 user nova-compute[75409]:       </nova:ports>
Nov 15 21:31:12 user nova-compute[75409]:     </nova:instance>
Nov 15 21:31:12 user nova-compute[75409]:   </metadata>
Nov 15 21:31:12 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:31:12 user nova-compute[75409]:     <system>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="serial">dd6c324b-f505-4391-813d-1534b5ed11ec</entry>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="uuid">dd6c324b-f505-4391-813d-1534b5ed11ec</entry>
Nov 15 21:31:12 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:31:12 user nova-compute[75409]:     </system>
Nov 15 21:31:12 user nova-compute[75409]:   </sysinfo>
Nov 15 21:31:12 user nova-compute[75409]:   <os>
Nov 15 21:31:12 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:31:12 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:31:12 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:31:12 user nova-compute[75409]:   </os>
Nov 15 21:31:12 user nova-compute[75409]:   <features>
Nov 15 21:31:12 user nova-compute[75409]:     <acpi/>
Nov 15 21:31:12 user nova-compute[75409]:     <apic/>
Nov 15 21:31:12 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:31:12 user nova-compute[75409]:   </features>
Nov 15 21:31:12 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:31:12 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:31:12 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:31:12 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:31:12 user nova-compute[75409]:   </clock>
Nov 15 21:31:12 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:31:12 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:31:12 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:31:12 user nova-compute[75409]:   </cpu>
Nov 15 21:31:12 user nova-compute[75409]:   <devices>
Nov 15 21:31:12 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:31:12 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:31:12 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk"/>
Nov 15 21:31:12 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:31:12 user nova-compute[75409]:     </disk>
Nov 15 21:31:12 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:31:12 user nova-compute[75409]:       <mac address="fa:16:3e:a8:66:00"/>
Nov 15 21:31:12 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:31:12 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:31:12 user nova-compute[75409]:       <target dev="tap7932a890-2f"/>
Nov 15 21:31:12 user nova-compute[75409]:     </interface>
Nov 15 21:31:12 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:31:12 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/console.log" append="off"/>
Nov 15 21:31:12 user nova-compute[75409]:     </serial>
Nov 15 21:31:12 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:31:12 user nova-compute[75409]:     <video>
Nov 15 21:31:12 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:31:12 user nova-compute[75409]:     </video>
Nov 15 21:31:12 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:31:12 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:31:12 user nova-compute[75409]:     </rng>
Nov 15 21:31:12 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:31:12 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:31:12 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:31:12 user nova-compute[75409]:     </memballoon>
Nov 15 21:31:12 user nova-compute[75409]:   </devices>
Nov 15 21:31:12 user nova-compute[75409]: </domain>
Nov 15 21:31:12 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-835053123',display_name='tempest-TestMinimumBasicScenario-server-835053123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-835053123',id=21,image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8TftujJxjBKxpzp2DVN3z6XO3dC/8H6HydHNNYLdsQlDXsiY+zdRKu4Enz/C2gJrwfapnr+ORMNOu1IAnjqGErYS5RYIIH9qOxZ7FtiHIt4EAV9DtJq1QjnS66mTABw==',key_name='tempest-TestMinimumBasicScenario-949963114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-wq0hhobb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:31:10Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=dd6c324b-f505-4391-813d-1534b5ed11ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG os_vif [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '706cff55-c159-549b-a1dc-8ddafb8b2149', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7932a890-2f, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7932a890-2f, col_values=(('qos', UUID('d6e4011f-78e7-4b47-b72a-c4c3280a7c87')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7932a890-2f, col_values=(('external_ids', {'iface-id': '7932a890-2f96-458d-b5dd-35159892f143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:66:00', 'vm-uuid': 'dd6c324b-f505-4391-813d-1534b5ed11ec'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:12 user nova-compute[75409]: INFO os_vif [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f')
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No VIF found with MAC fa:16:3e:a8:66:00, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updated VIF entry in instance network info cache for port 7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d327b4e8-c4dc-4b7e-b357-033f54211825 req-5600430a-9575-4615-8408-20e16491e4a3 service nova] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] No VIF found with MAC fa:16:3e:6b:96:4e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74e827c4-d59b-4eca-a373-f0a8ee2945ec tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.815s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:13 user nova-compute[75409]: INFO nova.compute.manager [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Detaching volume 4d517379-a4b0-4991-99cd-9b19a11adb7e
Nov 15 21:31:13 user nova-compute[75409]: INFO nova.virt.block_device [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Attempting to driver detach volume 4d517379-a4b0-4991-99cd-9b19a11adb7e from mountpoint /dev/vdb
Nov 15 21:31:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Attempting to detach device vdb from instance cd3765d7-3e52-4478-9c46-4aea89707638 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:13 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:13 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:13 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:13 user nova-compute[75409]:   <serial>4d517379-a4b0-4991-99cd-9b19a11adb7e</serial>
Nov 15 21:31:13 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:13 user nova-compute[75409]: </disk>
Nov 15 21:31:13 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Successfully detached device vdb from instance cd3765d7-3e52-4478-9c46-4aea89707638 from the persistent domain config.
Nov 15 21:31:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd3765d7-3e52-4478-9c46-4aea89707638 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:13 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:13 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:13 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:13 user nova-compute[75409]:   <serial>4d517379-a4b0-4991-99cd-9b19a11adb7e</serial>
Nov 15 21:31:13 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:13 user nova-compute[75409]: </disk>
Nov 15 21:31:13 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:14 user nova-compute[75409]: WARNING nova.compute.manager [req-7bde8361-bdce-42e8-ad7b-f4d7ee74b059 req-270b30f2-c7f3-456f-a800-bea4c27d60d7 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state building and task_state spawning.
Nov 15 21:31:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:16 user nova-compute[75409]: WARNING nova.compute.manager [req-b47241b9-96d9-4e01-98ef-416fabf21060 req-e909f4bb-c134-4ab5-8ae2-db7eb2928af4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state building and task_state spawning.
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:31:16 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance spawned successfully.
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:31:16 user nova-compute[75409]: INFO nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 15 21:31:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:31:16 user nova-compute[75409]: INFO nova.compute.manager [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Took 7.06 seconds to build instance.
Nov 15 21:31:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-319b6cf3-33a2-42ee-bed3-60cab9b1f1ff tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:25 user nova-compute[75409]: INFO nova.compute.manager [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Detaching volume 90b0e768-6889-4992-9dc2-9e3ae82a0498
Nov 15 21:31:25 user nova-compute[75409]: INFO nova.virt.block_device [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Attempting to driver detach volume 90b0e768-6889-4992-9dc2-9e3ae82a0498 from mountpoint /dev/vdb
Nov 15 21:31:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Attempting to detach device vdb from instance 4053527e-16c3-436b-916f-9d7ca3d2a11c from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:31:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:25 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:25 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:25 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:25 user nova-compute[75409]:   <serial>90b0e768-6889-4992-9dc2-9e3ae82a0498</serial>
Nov 15 21:31:25 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:25 user nova-compute[75409]: </disk>
Nov 15 21:31:25 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:25 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully detached device vdb from instance 4053527e-16c3-436b-916f-9d7ca3d2a11c from the persistent domain config.
Nov 15 21:31:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4053527e-16c3-436b-916f-9d7ca3d2a11c from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:31:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:25 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:25 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:25 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:25 user nova-compute[75409]:   <serial>90b0e768-6889-4992-9dc2-9e3ae82a0498</serial>
Nov 15 21:31:25 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:25 user nova-compute[75409]: </disk>
Nov 15 21:31:25 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:31:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a is timed out.
Nov 15 21:31:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Successfully detached device vdb from instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a from the live domain config.
Nov 15 21:31:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twFzeSDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:26 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a38fa27-ca1c-407d-9fe3-43e9794597c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:31:26 user nova-compute[75409]: No targets found.
Nov 15 21:31:26 user nova-compute[75409]: iSNS:
Nov 15 21:31:26 user nova-compute[75409]: No targets found.
Nov 15 21:31:26 user nova-compute[75409]: STATIC:
Nov 15 21:31:26 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e
Nov 15 21:31:26 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:26 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:26 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498
Nov 15 21:31:26 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:26 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:26 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0
Nov 15 21:31:26 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:26 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:26 user nova-compute[75409]: FIRMWARE:
Nov 15 21:31:26 user nova-compute[75409]: No targets found.
Nov 15 21:31:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:31:26 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:31:26 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37e401b-529a-42f0-b418-68ac1312556f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb00f9-e690-4600-a3a1-b2fbc1697d9e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:26 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:26 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 (non-flash)
Nov 15 21:31:26 user nova-compute[75409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:26 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf08740790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13af380-15a9-4cfe-acc9-c09d8d2bfa25]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5a2184-9693-4462-bc2b-b48187b8a668]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f118067-9148-4fca-bdfa-ad4cd136f924]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609ecc8-9831-437c-85be-573993661c3a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389a341-7a0e-4486-9a43-2fd9d491e8fc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c33e88f-bb4b-4c65-98f6-d06ffb3d6ca6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260]
Nov 15 21:31:26 user nova-compute[75409]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0db07f5-a51b-48cf-9842-0c6f1cd573e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ffc64-ea14-4e5f-8ed3-5babe6c2a3c2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] <== disconnect_volume: return (323ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:31:27 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'flavor' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d7eb7937-cdcc-43f4-9da7-a6a9ef511e56 tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-changed-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Refreshing instance network info cache due to event network-changed-13844262-7024-4a17-aeee-e83701073134. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] Acquiring lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] Acquired lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Refreshing network info cache for port 13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updated VIF entry in instance network info cache for port 13844262-7024-4a17-aeee-e83701073134. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updating instance_info_cache with network_info: [{"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2f17f487-c3b1-4d15-acfb-f869435487c7 req-53d4b7f0-9e87-4df3-affe-714949073bd2 service nova] Releasing lock "refresh_cache-c63d2f15-9011-4d63-80ff-989cee557e9e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing instance network info cache due to event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG nova.network.neutron [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:33 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd3765d7-3e52-4478-9c46-4aea89707638 is timed out.
Nov 15 21:31:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Successfully detached device vdb from instance cd3765d7-3e52-4478-9c46-4aea89707638 from the live domain config.
Nov 15 21:31:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCasJtDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:33 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca7a9d-5e73-4651-ac43-f810ef768e23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:31:34 user nova-compute[75409]: No targets found.
Nov 15 21:31:34 user nova-compute[75409]: iSNS:
Nov 15 21:31:34 user nova-compute[75409]: No targets found.
Nov 15 21:31:34 user nova-compute[75409]: STATIC:
Nov 15 21:31:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e
Nov 15 21:31:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498
Nov 15 21:31:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:34 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52
Nov 15 21:31:34 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:34 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:34 user nova-compute[75409]: FIRMWARE:
Nov 15 21:31:34 user nova-compute[75409]: No targets found.
Nov 15 21:31:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:31:34 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:31:34 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[57adb88c-baea-420f-8f5c-78f75ac0e072]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76862de-a2a4-445e-b9ce-399673b46790]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:34 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:34 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e (non-flash)
Nov 15 21:31:34 user nova-compute[75409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:34 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf48101d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ccf52-84c5-4828-b323-d06dbe15b435]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7956515-978c-4204-b80a-24f1821113c1]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c4be1-0e0f-4373-ac9c-903107b01179]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db0d031-3287-495a-b8c2-90c173911571]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[518aa4a4-181d-4cc8-806f-77ce6f4168e5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f296f53-b5e3-449a-8775-74413bbeeec5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260]
Nov 15 21:31:34 user nova-compute[75409]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:34 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d517379-a4b0-4991-99cd-9b19a11adb7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7f082-306f-486a-a482-47c28cc2bf1d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] <== disconnect_volume: return (323ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated VIF entry in instance network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-eb07ea3d-5c2f-4e21-91db-397b502bae7f req-8ceee1bc-bdfd-4d3d-bbbb-d6127ccd9a98 service nova] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lazy-loading 'flavor' on Instance uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-027bd0c3-1901-4eff-90ca-9317502b592b tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lazy-loading 'flavor' on Instance uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:35 user nova-compute[75409]: INFO nova.compute.manager [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Attaching volume bd20a1b4-2bef-408a-83ad-14934543b40c to /dev/sdc
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.utils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc5233-3559-4e9a-9fbe-d71dced10f8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed8823-40cc-4661-995f-e8719e35e35e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d786e8bb-bf8d-4284-ab78-d39fca561c05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b8b6a-9fb5-48ea-97d2-641d14104d24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:35 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:31:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588f9c3-c9af-430b-a68f-604ade00091b]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG os_brick.utils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:35 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updating existing volume attachment record: a4b1843a-c447-42ed-869e-6146535161b2 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:31:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:31:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [{"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-cd3765d7-3e52-4478-9c46-4aea89707638" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfrFNoLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:41 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:41 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:41 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:31:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-changed-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Refreshing instance network info cache due to event network-changed-d3bdf0e2-5778-4821-ab53-c74fbbd298b2. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] Acquiring lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] Acquired lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG nova.network.neutron [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Refreshing network info cache for port d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f9da0-51f3-4fc3-9708-c3cf28a97343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:31:41 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d39297a-704e-480c-a5b3-1fcc5669464b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c] added
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[da651aea-9d6c-4fa7-a429-53f418c5034f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9efbf-c7c5-4838-8f98-abe3b98ca9db]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfrFNoLu {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfrFNoLu" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a6097d-c1a6-408c-883e-24f145c6799c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfrFNoLu'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e490d465-2b06-4456-b943-5cfc61862685]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e05fe-2db5-4a60-b721-2c59fb7e2595]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8092a-9f50-4c66-a5db-8c193eca7149]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260]
Nov 15 21:31:41 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[614fc7e0-8eaf-43fe-b970-f3cb51afce93]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d831e-ab4d-4ab3-ad18-04f79365404c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:41 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3b2ea-a249-408c-aae9-08c28abdfd3c]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfrFNoLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG nova.network.neutron [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updated VIF entry in instance network info cache for port d3bdf0e2-5778-4821-ab53-c74fbbd298b2. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG nova.network.neutron [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cdbd7a8e-e815-413e-b4b3-0849bdd29cb4 req-9b8e94ea-e29d-4c7f-952f-97623de095cd service nova] Releasing lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23637363166313664', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637363166313664', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lazy-loading 'flavor' on Instance uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:31:42 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:42 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:42 user nova-compute[75409]:   <target dev="sdc" bus="scsi"/>
Nov 15 21:31:42 user nova-compute[75409]:   <serial>bd20a1b4-2bef-408a-83ad-14934543b40c</serial>
Nov 15 21:31:42 user nova-compute[75409]:   <address type="drive" controller="0" unit="2"/>
Nov 15 21:31:42 user nova-compute[75409]: </disk>
Nov 15 21:31:42 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'flavor' on Instance uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:43 user nova-compute[75409]: INFO nova.compute.manager [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Attaching volume 7b1b0016-4dfe-4b81-8bfe-fa6254c18eec to /dev/vdb
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No BDM found with device name sda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] No VIF found with MAC fa:16:3e:48:7a:9f, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.utils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd810c-5d04-4c8e-9a0e-1f52d8d21517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8d003-a5ea-4b81-8835-7bc22855d9f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50499e2-cf5c-442b-922b-dc30e2a1c8dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b0bb0b-2ea2-4c3f-b524-639687096077]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9181caba-6644-49d8-87ed-561002731ded tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.328s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:31:43 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de14a9-8abd-420e-b676-433b8fa0bf20]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG os_brick.utils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating existing volume attachment record: 1a4d9b83-b974-45e4-8370-31d833aa83ab {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:44 user nova-compute[75409]: INFO nova.compute.manager [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Detaching volume bd20a1b4-2bef-408a-83ad-14934543b40c
Nov 15 21:31:44 user nova-compute[75409]: INFO nova.virt.block_device [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Attempting to driver detach volume bd20a1b4-2bef-408a-83ad-14934543b40c from mountpoint /dev/sdc
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Attempting to detach device sdc from instance c63d2f15-9011-4d63-80ff-989cee557e9e from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:44 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:44 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:44 user nova-compute[75409]:   <target dev="sdc" bus="scsi"/>
Nov 15 21:31:44 user nova-compute[75409]:   <serial>bd20a1b4-2bef-408a-83ad-14934543b40c</serial>
Nov 15 21:31:44 user nova-compute[75409]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 21:31:44 user nova-compute[75409]: </disk>
Nov 15 21:31:44 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Successfully detached device sdc from instance c63d2f15-9011-4d63-80ff-989cee557e9e from the persistent domain config.
Nov 15 21:31:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c63d2f15-9011-4d63-80ff-989cee557e9e from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:44 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:44 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:31:44 user nova-compute[75409]:   <target dev="sdc" bus="scsi"/>
Nov 15 21:31:44 user nova-compute[75409]:   <serial>bd20a1b4-2bef-408a-83ad-14934543b40c</serial>
Nov 15 21:31:44 user nova-compute[75409]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 21:31:44 user nova-compute[75409]: </disk>
Nov 15 21:31:44 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:31:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:31:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=24.623504638671875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance cd3765d7-3e52-4478-9c46-4aea89707638 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 4053527e-16c3-436b-916f-9d7ca3d2a11c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c63d2f15-9011-4d63-80ff-989cee557e9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dd6c324b-f505-4391-813d-1534b5ed11ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:31:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:31:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4053527e-16c3-436b-916f-9d7ca3d2a11c is timed out.
Nov 15 21:31:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully detached device vdb from instance 4053527e-16c3-436b-916f-9d7ca3d2a11c from the live domain config.
Nov 15 21:31:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLxDfPZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:46 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eab1ba-7f05-4273-8de7-acdd492ad645]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:31:46 user nova-compute[75409]: No targets found.
Nov 15 21:31:46 user nova-compute[75409]: iSNS:
Nov 15 21:31:46 user nova-compute[75409]: No targets found.
Nov 15 21:31:46 user nova-compute[75409]: STATIC:
Nov 15 21:31:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498
Nov 15 21:31:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c
Nov 15 21:31:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52
Nov 15 21:31:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:46 user nova-compute[75409]: FIRMWARE:
Nov 15 21:31:46 user nova-compute[75409]: No targets found.
Nov 15 21:31:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:31:46 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:31:46 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a715fc-7a46-447b-9407-51aaac4c0e7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f08b7-f37c-4432-82f6-106b2cd227b7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:46 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:46 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 (non-flash)
Nov 15 21:31:46 user nova-compute[75409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:46 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf2852c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af7711-d6b7-4391-b89a-f0866b385e89]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c4fe3-1b49-461e-8ad2-e0dce1bdd968]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6c5c8-08f0-4acb-b3f8-a094c9d3faaa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.092s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64589fb1-046f-4930-882d-2ef30d4ead99]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b8fd8-77ed-433a-a1bd-e541065ad14c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --logout" returned: 0 in 0.155s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4d72b-9726-43a9-9370-f5fa6454a6c1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260]
Nov 15 21:31:46 user nova-compute[75409]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.118s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71806d76-f1e0-4e63-a934-3a2a0e50d3e5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.602s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== disconnect_volume: return (604ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:31:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'flavor' on Instance uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d21e5b80-1239-4d93-ae55-56d6c182d5a6 tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.114s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.953s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:48 user nova-compute[75409]: INFO nova.compute.manager [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Terminating instance
Nov 15 21:31:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-7635ef8e-3871-45a9-8362-3a296fc63f00 req-d4f196c5-dafd-43cf-b3aa-4316c5c70cd1 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNwyMKSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:50 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:50 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:50 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58a448-5eab-474d-85b4-7fb0b935eff6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:31:50 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b8487-a72a-4ff6-a500-ecabe27e37f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec] added
Nov 15 21:31:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.087s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9f0d1-9c41-4f5e-b42f-ce58e4121ccc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.194s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a201f25e-9b30-4330-b48b-ca556f58f799]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNwyMKSO {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNwyMKSO" returned: 0 in 0.111s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e0929e-9448-4b72-a514-71cd28a0c4c4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNwyMKSO'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b412a4-b9f6-4756-8d18-e390b1f9bd85]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e020d-d26c-4bd7-a5ba-639eac6660e6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:50 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:50 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --login" returned: 0 in 0.167s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55d8aa0-8857-4681-ab79-d344a4267451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260]
Nov 15 21:31:50 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260] successful.
Nov 15 21:31:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Instance destroyed successfully.
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lazy-loading 'resources' on Instance uuid 4053527e-16c3-436b-916f-9d7ca3d2a11c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1989092853',display_name='tempest-VolumesSnapshotTestJSON-instance-1989092853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1989092853',id=17,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3W5YGl5Vx30PEfk+3q7Xe/zx+MrlrpUOnjn+mDmUGTd0rM/6xNP8dX3flnGGG8bT/YbVTHEpJInQOgZ4q9eluOuzxns11epcPXokufv5aK219L5BX04c2QtdAo/Pkz9Q==',key_name='tempest-keypair-149374748',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='009284b3fdbd4f4ab5887b35b1fc56cb',ramdisk_id='',reservation_id='r-f0cgzspj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2115825168',owner_user_name='tempest-VolumesSnapshotTestJSON-2115825168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='098f422f38cb4addab5b34395aac505a',uuid=4053527e-16c3-436b-916f-9d7ca3d2a11c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converting VIF {"id": "69936157-ea9c-4bd6-8ad9-42df18e567be", "address": "fa:16:3e:6b:96:4e", "network": {"id": "f8c35c4e-d8f6-44af-bfd1-7d4007f39972", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-319896730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009284b3fdbd4f4ab5887b35b1fc56cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69936157-ea", "ovs_interfaceid": "69936157-ea9c-4bd6-8ad9-42df18e567be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_vif [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69936157-ea, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bff773a-acb1-4db0-9b5f-a120863f3ffc) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.160s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547bcae-5e32-470f-aa98-bf806ee76c3d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:31:50 user nova-compute[75409]: INFO os_vif [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=69936157-ea9c-4bd6-8ad9-42df18e567be,network=Network(f8c35c4e-d8f6-44af-bfd1-7d4007f39972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69936157-ea')
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLxDfPZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:31:50 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3897193b-c104-451b-9a26-76cf1811e90a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:51 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:51 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:31:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:51 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:51 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:31:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.940s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c24a29-490b-40e2-8a68-7d5acdf5b2cf]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNwyMKSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:51 user nova-compute[75409]: WARNING nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state active and task_state deleting.
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:51 user nova-compute[75409]: WARNING nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state active and task_state deleting.
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:51 user nova-compute[75409]: WARNING nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state active and task_state deleting.
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-unplugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Acquiring lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] No waiting events found dispatching network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:51 user nova-compute[75409]: WARNING nova.compute.manager [req-05d93ae2-34a2-4444-a6f3-9b3e18fc3875 req-8d1f2dbf-490b-4eb6-8c1a-923220d79228 service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received unexpected event network-vif-plugged-69936157-ea9c-4bd6-8ad9-42df18e567be for instance with vm_state active and task_state deleting.
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.986s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] <== connect_volume: return (1987ms) {'type': 'block', 'scsi_wwn': '26330356563363537', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330356563363537', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.069s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'flavor' on Instance uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[335cf9ad-4030-4f2a-9989-106e4b9c0789]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:31:52 user nova-compute[75409]: No targets found.
Nov 15 21:31:52 user nova-compute[75409]: iSNS:
Nov 15 21:31:52 user nova-compute[75409]: No targets found.
Nov 15 21:31:52 user nova-compute[75409]: STATIC:
Nov 15 21:31:52 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c
Nov 15 21:31:52 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:52 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:52 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52
Nov 15 21:31:52 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:52 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:52 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec
Nov 15 21:31:52 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:31:52 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:31:52 user nova-compute[75409]: FIRMWARE:
Nov 15 21:31:52 user nova-compute[75409]: No targets found.
Nov 15 21:31:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:31:52 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:31:52 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b0e768-6889-4992-9dc2-9e3ae82a0498', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:31:52 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:52 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:52 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:52 user nova-compute[75409]:   <serial>7b1b0016-4dfe-4b81-8bfe-fa6254c18eec</serial>
Nov 15 21:31:52 user nova-compute[75409]: </disk>
Nov 15 21:31:52 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e8061-3c58-483c-9c12-cfeada8b0797]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f4d398-476f-4199-8f0d-70afc27a995e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:52 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:52 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:31:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a01482e-b61a-40eb-bea3-88246a9cff52 (non-flash)
Nov 15 21:31:52 user nova-compute[75409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:31:52 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:31:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf480b81f0>, {}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Disconnecting from: [] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] <== disconnect_volume: return (1148ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:31:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Deleting instance files /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c_del
Nov 15 21:31:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Deletion of /opt/stack/data/nova/instances/4053527e-16c3-436b-916f-9d7ca3d2a11c_del complete
Nov 15 21:31:52 user nova-compute[75409]: INFO nova.compute.manager [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Took 3.62 seconds to destroy the instance on the hypervisor.
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No VIF found with MAC fa:16:3e:21:73:ec, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:31:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b3943190-95e8-426b-acd4-d28fa636a300 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.192s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Took 0.85 seconds to deallocate network for instance.
Nov 15 21:31:53 user nova-compute[75409]: WARNING nova.volume.cinder [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Attachment 54897036-4bba-443e-b7d1-c5fe1920bc01 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 54897036-4bba-443e-b7d1-c5fe1920bc01. (HTTP 404) (Request-ID: req-c7abb856-9db2-474f-8ba6-49b43b178578)
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.compute.manager [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Deleted allocations for instance 4053527e-16c3-436b-916f-9d7ca3d2a11c
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-41a285d3-26c1-4333-8f03-06fae29a1fee tempest-VolumesSnapshotTestJSON-2115825168 tempest-VolumesSnapshotTestJSON-2115825168-project-member] Lock "4053527e-16c3-436b-916f-9d7ca3d2a11c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.056s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.compute.manager [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Detaching volume 7b1b0016-4dfe-4b81-8bfe-fa6254c18eec
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.virt.block_device [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Attempting to driver detach volume 7b1b0016-4dfe-4b81-8bfe-fa6254c18eec from mountpoint /dev/vdb
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Attempting to detach device vdb from instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:53 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:53 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:53 user nova-compute[75409]:   <serial>7b1b0016-4dfe-4b81-8bfe-fa6254c18eec</serial>
Nov 15 21:31:53 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:53 user nova-compute[75409]: </disk>
Nov 15 21:31:53 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully detached device vdb from instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 from the persistent domain config.
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:31:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:31:53 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:31:53 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:31:53 user nova-compute[75409]:   <serial>7b1b0016-4dfe-4b81-8bfe-fa6254c18eec</serial>
Nov 15 21:31:53 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:31:53 user nova-compute[75409]: </disk>
Nov 15 21:31:53 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:31:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-7d3ad978-dbdb-46a8-accc-e99dedf97cf3 req-b533abc5-325f-4009-9927-72bd15993fca service nova] [instance: 4053527e-16c3-436b-916f-9d7ca3d2a11c] Received event network-vif-deleted-69936157-ea9c-4bd6-8ad9-42df18e567be {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:31:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:56 user nova-compute[75409]: INFO nova.compute.manager [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Terminating instance
Nov 15 21:31:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-7db7f884-c20c-4941-9991-6d9d7a49182a req-9545cd40-ee6b-4534-a9a7-74b139e0212a service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-unplugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:31:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Instance destroyed successfully.
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lazy-loading 'resources' on Instance uuid c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1024966487',display_name='tempest-ServerStableDeviceRescueTest-server-1024966487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1024966487',id=3,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1w3IwZQuzhmYOZjDB4CqzB1nMbLgLze4h5chIWpKA4h1n2nTIX0cJ63BLH/trwf5U0b+0WEPiz8w1cfw9G1Qlei7+sz4fsrvhsxZbXV12IkJeUKMyv1vf8JHbr5WdKLA==',key_name='tempest-keypair-1226690818',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d175092693d4075a673abd4700224b4',ramdisk_id='',reservation_id='r-l0an1ygs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1415887716',owner_user_name='tempest-ServerStableDeviceRescueTest-1415887716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dc1671b61544734b8af9c67182684ad',uuid=c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converting VIF {"id": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "address": "fa:16:3e:82:40:c6", "network": {"id": "b6486960-60df-4826-9e0c-0eeb577f57d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1446128623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d175092693d4075a673abd4700224b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d82c8f-30", "ovs_interfaceid": "35d82c8f-3046-4e3b-85ba-ba91853e4cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG os_vif [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d82c8f-30, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2adcd2cb-bf11-4bf7-9f86-5054d5bbcbb9) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:31:57 user nova-compute[75409]: INFO os_vif [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=35d82c8f-3046-4e3b-85ba-ba91853e4cb5,network=Network(b6486960-60df-4826-9e0c-0eeb577f57d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35d82c8f-30')
Nov 15 21:31:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Deleting instance files /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a_del
Nov 15 21:31:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Deletion of /opt/stack/data/nova/instances/c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a_del complete
Nov 15 21:31:57 user nova-compute[75409]: INFO nova.compute.manager [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 15 21:31:57 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:31:57 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:31:58 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Took 1.00 seconds to deallocate network for instance.
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-f1293a44-4a31-42ee-a544-41f5463b8e93 req-c6638de4-e5eb-4634-9945-cf71a7640063 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-deleted-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:58 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Deleted allocations for instance c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4b66acd1-5e27-420b-b12b-9ba7d3c864bf tempest-ServerStableDeviceRescueTest-1415887716 tempest-ServerStableDeviceRescueTest-1415887716-project-member] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.509s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] Acquiring lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] Lock "c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:31:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] No waiting events found dispatching network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:31:58 user nova-compute[75409]: WARNING nova.compute.manager [req-5ab12c42-25f1-4dd1-a6b1-f92006ea4414 req-d5a4e248-6a87-47ed-aa19-7a026575c649 service nova] [instance: c7a6430b-a9bd-4d0b-9e69-3c98a2d4a31a] Received unexpected event network-vif-plugged-35d82c8f-3046-4e3b-85ba-ba91853e4cb5 for instance with vm_state deleted and task_state None.
Nov 15 21:31:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:32:01 user nova-compute[75409]: INFO nova.compute.claims [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Claim successful on node user
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:32:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.policy [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceded6a59a6842e792ad3aced2b85da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dfeeef89eb4141be700d34d6d0f1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:32:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Creating image(s)
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk 1073741824" returned: 0 in 0.054s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Successfully created port: 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Cannot resize image /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Successfully updated port: 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing instance network info cache due to event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:32:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance network_info: |[{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start _get_guest_xml network_info=[{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:32:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj9lkJ6JzRsVuY9EzWH5rwqPrEhaA7v1OPNfnzbdOycYveda2BsQWNpXeLTQvoXJfAFhKfsnDcixZPRU8xSSStrOo3gtyKqlf2Vlrw1iUYt0iSxmaULBDrmr++uYHaSkA==',key_name='tempest-keypair-867532891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_devices' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:32:03 user nova-compute[75409]:   <uuid>77526585-a92a-411a-ad4b-ddf79ef1a3c4</uuid>
Nov 15 21:32:03 user nova-compute[75409]:   <name>instance-00000016</name>
Nov 15 21:32:03 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:32:03 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:32:03 user nova-compute[75409]:   <metadata>
Nov 15 21:32:03 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:32:03 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1416183420</nova:name>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:32:03</nova:creationTime>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:32:03 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:32:03 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:owner>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:user uuid="ceded6a59a6842e792ad3aced2b85da9">tempest-AttachVolumeShelveTestJSON-1237497947-project-member</nova:user>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:project uuid="46dfeeef89eb4141be700d34d6d0f1ea">tempest-AttachVolumeShelveTestJSON-1237497947</nova:project>
Nov 15 21:32:03 user nova-compute[75409]:       </nova:owner>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:32:03 user nova-compute[75409]:       <nova:ports>
Nov 15 21:32:03 user nova-compute[75409]:         <nova:port uuid="143fa542-7e29-448e-b41a-4c7ee6d89621">
Nov 15 21:32:03 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:32:03 user nova-compute[75409]:         </nova:port>
Nov 15 21:32:03 user nova-compute[75409]:       </nova:ports>
Nov 15 21:32:03 user nova-compute[75409]:     </nova:instance>
Nov 15 21:32:03 user nova-compute[75409]:   </metadata>
Nov 15 21:32:03 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:32:03 user nova-compute[75409]:     <system>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="serial">77526585-a92a-411a-ad4b-ddf79ef1a3c4</entry>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="uuid">77526585-a92a-411a-ad4b-ddf79ef1a3c4</entry>
Nov 15 21:32:03 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:32:03 user nova-compute[75409]:     </system>
Nov 15 21:32:03 user nova-compute[75409]:   </sysinfo>
Nov 15 21:32:03 user nova-compute[75409]:   <os>
Nov 15 21:32:03 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:32:03 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:32:03 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:32:03 user nova-compute[75409]:   </os>
Nov 15 21:32:03 user nova-compute[75409]:   <features>
Nov 15 21:32:03 user nova-compute[75409]:     <acpi/>
Nov 15 21:32:03 user nova-compute[75409]:     <apic/>
Nov 15 21:32:03 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:32:03 user nova-compute[75409]:   </features>
Nov 15 21:32:03 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:32:03 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:32:03 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:32:03 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:32:03 user nova-compute[75409]:   </clock>
Nov 15 21:32:03 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:32:03 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:32:03 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:32:03 user nova-compute[75409]:   </cpu>
Nov 15 21:32:03 user nova-compute[75409]:   <devices>
Nov 15 21:32:03 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:32:03 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:32:03 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk"/>
Nov 15 21:32:03 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:32:03 user nova-compute[75409]:     </disk>
Nov 15 21:32:03 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:32:03 user nova-compute[75409]:       <mac address="fa:16:3e:9c:1e:f7"/>
Nov 15 21:32:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:32:03 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:32:03 user nova-compute[75409]:       <target dev="tap143fa542-7e"/>
Nov 15 21:32:03 user nova-compute[75409]:     </interface>
Nov 15 21:32:03 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:32:03 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/console.log" append="off"/>
Nov 15 21:32:03 user nova-compute[75409]:     </serial>
Nov 15 21:32:03 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:32:03 user nova-compute[75409]:     <video>
Nov 15 21:32:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:32:03 user nova-compute[75409]:     </video>
Nov 15 21:32:03 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:32:03 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:32:03 user nova-compute[75409]:     </rng>
Nov 15 21:32:03 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:32:03 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:32:03 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:32:03 user nova-compute[75409]:     </memballoon>
Nov 15 21:32:03 user nova-compute[75409]:   </devices>
Nov 15 21:32:03 user nova-compute[75409]: </domain>
Nov 15 21:32:03 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj9lkJ6JzRsVuY9EzWH5rwqPrEhaA7v1OPNfnzbdOycYveda2BsQWNpXeLTQvoXJfAFhKfsnDcixZPRU8xSSStrOo3gtyKqlf2Vlrw1iUYt0iSxmaULBDrmr++uYHaSkA==',key_name='tempest-keypair-867532891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG os_vif [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99c00519-ef04-5002-a3ea-a89513e2940d', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap143fa542-7e, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap143fa542-7e, col_values=(('qos', UUID('d4cdf62c-724c-48df-9e01-aabe00b3a8b1')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap143fa542-7e, col_values=(('external_ids', {'iface-id': '143fa542-7e29-448e-b41a-4c7ee6d89621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:1e:f7', 'vm-uuid': '77526585-a92a-411a-ad4b-ddf79ef1a3c4'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:03 user nova-compute[75409]: INFO os_vif [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e')
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No VIF found with MAC fa:16:3e:9c:1e:f7, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updated VIF entry in instance network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG nova.network.neutron [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0984b28a-e1d5-44b0-9914-dcfd75a64b86 req-7bcc24a4-efc2-4399-9037-c0b5b03021c0 service nova] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:32:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:05 user nova-compute[75409]: WARNING nova.compute.manager [req-408d5b30-b206-4a02-b1ee-15ed299e3972 req-c6293674-cb96-4e0a-98cf-e337861cf1ee service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state building and task_state spawning.
Nov 15 21:32:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance c63d2f15-9011-4d63-80ff-989cee557e9e is timed out.
Nov 15 21:32:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Successfully detached device sdc from instance c63d2f15-9011-4d63-80ff-989cee557e9e from the live domain config.
Nov 15 21:32:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfrFNoLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:32:05 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1970c843-4fc0-4e90-aa2e-d57942caaace]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:32:05 user nova-compute[75409]: No targets found.
Nov 15 21:32:05 user nova-compute[75409]: iSNS:
Nov 15 21:32:05 user nova-compute[75409]: No targets found.
Nov 15 21:32:05 user nova-compute[75409]: STATIC:
Nov 15 21:32:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c
Nov 15 21:32:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:32:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:32:05 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec
Nov 15 21:32:05 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:32:05 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:32:05 user nova-compute[75409]: FIRMWARE:
Nov 15 21:32:05 user nova-compute[75409]: No targets found.
Nov 15 21:32:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:32:05 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:32:05 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[346c7bf2-6eaf-4fd5-9d55-a4a0ef808ab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0050451-2358-47f9-93d7-355683da741d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:32:05 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:32:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c (non-flash)
Nov 15 21:32:05 user nova-compute[75409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:32:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087270a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2061b-d663-4dd6-bdd0-883fd50bf17b]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ade43-24b9-478b-8c80-d83a62d45a3c]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4c994-db90-4b47-84c9-0a9e40f560c8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:05 user nova-compute[75409]: INFO nova.compute.manager [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Terminating instance
Nov 15 21:32:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25061d4-dc77-4de7-b453-e838550ddd65]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b20c6-873b-4744-9e6b-2757d694daac]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2bd1d-0c53-4a4c-886c-39431e68c165]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260]
Nov 15 21:32:06 user nova-compute[75409]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c, portal: 172.16.0.220,3260] successful.
Nov 15 21:32:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd20a1b4-2bef-408a-83ad-14934543b40c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82599c-ba95-4dd0-8b2e-a737e97f792f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] <== disconnect_volume: return (342ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-unplugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] No waiting events found dispatching network-vif-unplugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-f775cdfb-ff92-47dc-a8b1-2b4654d07f92 req-9becf73a-3537-4238-8133-ac40bf81699a service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-unplugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:32:06 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Instance destroyed successfully.
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lazy-loading 'resources' on Instance uuid cd3765d7-3e52-4478-9c46-4aea89707638 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1719741347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1719741',id=15,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbR69zJNLPyfBV0/KK8TLrS7/jC7X6DQ1uBzu/szPRKrFzvIGHZJmhnvfkSO0hFmEb/58X2hCr/Hp7kR64eezoxg0hV9WgEVw/TJ/NGO/7RLllIOTBbNNmyiPuCEUStAA==',key_name='tempest-keypair-956081336',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90b1cf2e458a42038e1d791ae5fd2a68',ramdisk_id='',reservation_id='r-75yqigx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81a94d16ea245199ef3e5eda3504e0f',uuid=cd3765d7-3e52-4478-9c46-4aea89707638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converting VIF {"id": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "address": "fa:16:3e:3a:0a:7e", "network": {"id": "c32d2d13-6acb-4066-9303-efb1f347ed10", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-466195330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b1cf2e458a42038e1d791ae5fd2a68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41267a36-85", "ovs_interfaceid": "41267a36-8581-4112-9fb3-6ab7b641c7a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG os_vif [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41267a36-85, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7c530ab-2b83-4114-9b17-6e96abd346cd) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:06 user nova-compute[75409]: INFO os_vif [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0a:7e,bridge_name='br-int',has_traffic_filtering=True,id=41267a36-8581-4112-9fb3-6ab7b641c7a0,network=Network(c32d2d13-6acb-4066-9303-efb1f347ed10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41267a36-85')
Nov 15 21:32:06 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Deleting instance files /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638_del
Nov 15 21:32:06 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Deletion of /opt/stack/data/nova/instances/cd3765d7-3e52-4478-9c46-4aea89707638_del complete
Nov 15 21:32:06 user nova-compute[75409]: INFO nova.compute.manager [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lazy-loading 'flavor' on Instance uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-faa7ea25-7c30-45ea-8922-28366cc9156b tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.363s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:07 user nova-compute[75409]: WARNING nova.compute.manager [req-ea228300-3a92-4e26-9849-c8c8372eee40 req-07d82d54-12bd-4a44-9154-33a6d2fff7c0 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state building and task_state spawning.
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:32:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance spawned successfully.
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:07 user nova-compute[75409]: INFO nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:32:07 user nova-compute[75409]: INFO nova.compute.manager [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Took 6.50 seconds to build instance.
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a6f49673-4523-43b5-82c5-112476cf0bec tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.636s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:07 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Took 0.69 seconds to deallocate network for instance.
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-51cb01d1-d9fc-49ef-ba45-14ccb91d0c25 req-ae8f1f53-aceb-4cc6-9534-93050036871b service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-deleted-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:07 user nova-compute[75409]: INFO nova.compute.manager [req-51cb01d1-d9fc-49ef-ba45-14ccb91d0c25 req-ae8f1f53-aceb-4cc6-9534-93050036871b service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Neutron deleted interface 41267a36-8581-4112-9fb3-6ab7b641c7a0; detaching it from the instance and deleting it from the info cache
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-51cb01d1-d9fc-49ef-ba45-14ccb91d0c25 req-ae8f1f53-aceb-4cc6-9534-93050036871b service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-51cb01d1-d9fc-49ef-ba45-14ccb91d0c25 req-ae8f1f53-aceb-4cc6-9534-93050036871b service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Detach interface failed, port_id=41267a36-8581-4112-9fb3-6ab7b641c7a0, reason: Instance cd3765d7-3e52-4478-9c46-4aea89707638 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:32:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:08 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Deleted allocations for instance cd3765d7-3e52-4478-9c46-4aea89707638
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2d70a10-ad29-40cd-b7a4-500902feded0 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315 tempest-TestServerVolumeAttachScenarioOldVersion-1894207315-project-member] Lock "cd3765d7-3e52-4478-9c46-4aea89707638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:08 user nova-compute[75409]: INFO nova.compute.manager [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Terminating instance
Nov 15 21:32:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] Acquiring lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] Lock "cd3765d7-3e52-4478-9c46-4aea89707638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] No waiting events found dispatching network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:08 user nova-compute[75409]: WARNING nova.compute.manager [req-f58ddbf8-aafd-4b30-a7ab-d0e3899bd399 req-c38799e5-383f-416b-b7ce-9909821a5c44 service nova] [instance: cd3765d7-3e52-4478-9c46-4aea89707638] Received unexpected event network-vif-plugged-41267a36-8581-4112-9fb3-6ab7b641c7a0 for instance with vm_state deleted and task_state None.
Nov 15 21:32:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Instance destroyed successfully.
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.objects.instance [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lazy-loading 'resources' on Instance uuid c63d2f15-9011-4d63-80ff-989cee557e9e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T21:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535057495',display_name='tempest-AttachSCSIVolumeTestJSON-server-535057495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535057495',id=18,image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1dUxVXx95UNnEYPCx5tbaKrkAbFEz30H2LygKzbjx9XUwO+ws3+NpPtnfjVl/JhsTKYgFl01G4roKjnsKwGyXCuA7YOmip9eEMqWusUKPmpcnAoGrpfGQJl1O6ecWrtg==',key_name='tempest-keypair-1518408183',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8afbc54d02744b01aa76fc461daa2d69',ramdisk_id='',reservation_id='r-fh98op5f',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c25f7be-90b0-4a48-bd5c-c439c5790464',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418663166',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418663166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:29:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab9adbc384444705b6566cf97fd6bf2f',uuid=c63d2f15-9011-4d63-80ff-989cee557e9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converting VIF {"id": "13844262-7024-4a17-aeee-e83701073134", "address": "fa:16:3e:48:7a:9f", "network": {"id": "4c33ffcc-6115-42b9-956c-af0997a79a69", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-327261387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8afbc54d02744b01aa76fc461daa2d69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13844262-70", "ovs_interfaceid": "13844262-7024-4a17-aeee-e83701073134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG os_vif [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13844262-70, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2c04ec9-42aa-4dd8-a26c-5e32b8ac851a) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: INFO os_vif [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:7a:9f,bridge_name='br-int',has_traffic_filtering=True,id=13844262-7024-4a17-aeee-e83701073134,network=Network(4c33ffcc-6115-42b9-956c-af0997a79a69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13844262-70')
Nov 15 21:32:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Deleting instance files /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e_del
Nov 15 21:32:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Deletion of /opt/stack/data/nova/instances/c63d2f15-9011-4d63-80ff-989cee557e9e_del complete
Nov 15 21:32:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:09 user nova-compute[75409]: INFO nova.compute.manager [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-unplugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] No waiting events found dispatching network-vif-unplugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-unplugged-13844262-7024-4a17-aeee-e83701073134 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Acquiring lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] No waiting events found dispatching network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:09 user nova-compute[75409]: WARNING nova.compute.manager [req-c8e941ef-220b-4c79-ba0d-e0ef32d78603 req-c8bb3411-228c-4ba4-b2bb-a45e48d04e36 service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received unexpected event network-vif-plugged-13844262-7024-4a17-aeee-e83701073134 for instance with vm_state active and task_state deleting.
Nov 15 21:32:10 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:10 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Took 0.72 seconds to deallocate network for instance.
Nov 15 21:32:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:32:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:32:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:10 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Deleted allocations for instance c63d2f15-9011-4d63-80ff-989cee557e9e
Nov 15 21:32:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-22f2175f-ca15-4c87-98ac-8511c0c4bb44 tempest-AttachSCSIVolumeTestJSON-418663166 tempest-AttachSCSIVolumeTestJSON-418663166-project-member] Lock "c63d2f15-9011-4d63-80ff-989cee557e9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-ca7b49cc-f29b-49c7-96a5-968a0574b093 req-6aad3771-1364-47f6-ad97-48dd857481fb service nova] [instance: c63d2f15-9011-4d63-80ff-989cee557e9e] Received event network-vif-deleted-13844262-7024-4a17-aeee-e83701073134 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:14 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 is timed out.
Nov 15 21:32:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully detached device vdb from instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 from the live domain config.
Nov 15 21:32:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNwyMKSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:32:14 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344d241-37ca-44ce-8737-561d501bc25d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:32:14 user nova-compute[75409]: No targets found.
Nov 15 21:32:14 user nova-compute[75409]: iSNS:
Nov 15 21:32:14 user nova-compute[75409]: No targets found.
Nov 15 21:32:14 user nova-compute[75409]: STATIC:
Nov 15 21:32:14 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec
Nov 15 21:32:14 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:32:14 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:32:14 user nova-compute[75409]: FIRMWARE:
Nov 15 21:32:14 user nova-compute[75409]: No targets found.
Nov 15 21:32:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:32:14 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:32:14 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[046249f3-5858-440c-a795-8b0736a6e13b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c127e0-2cb2-47b6-b6ec-fab7dcc0ccf8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:32:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec (non-flash)
Nov 15 21:32:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28504ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c6b4a-7eb0-4a70-9235-9d43bfbf4cce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b012769-90c1-4266-8bc8-260ebbcbddba]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751f2af-0dbb-4439-a7f9-dec62f8cc2a3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697b74c-2e08-40aa-b2b4-2a18d956fd2b]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be6b3fb-d594-45fe-b3ff-e17db33f4b09]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff33137c-8b11-4fd4-8fda-b762b8e2183a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260]
Nov 15 21:32:14 user nova-compute[75409]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec, portal: 172.16.0.220,3260] successful.
Nov 15 21:32:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b1b0016-4dfe-4b81-8bfe-fa6254c18eec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0af63-0189-4e1f-88ca-58a9300edd39]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] <== disconnect_volume: return (264ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:32:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:32:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'flavor' on Instance uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cbf77fd7-846a-4dd0-b27e-ecb2040b6063 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:32:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:32:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:32:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=25.231159210205078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dd6c324b-f505-4391-813d-1534b5ed11ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77526585-a92a-411a-ad4b-ddf79ef1a3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d3016724-0848-47b3-905e-c4f1700b14a3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.261s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:32:45 user nova-compute[75409]: INFO nova.compute.claims [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Claim successful on node user
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:32:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:32:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.policy [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1dcb2c6a3fc42d08d6af32d01475751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddec4e015c454beea9d9814218dad1c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:32:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Creating image(s)
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "/opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "/opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk 1073741824" returned: 0 in 0.058s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Successfully created port: 34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:32:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Cannot resize image /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Ensure instance console log exists: /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Successfully updated port: 34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquired lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-changed-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Refreshing instance network info cache due to event network-changed-34b9f659-4301-4626-bbae-9676e903c33b. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] Acquiring lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:32:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Updating instance_info_cache with network_info: [{"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Releasing lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Instance network_info: |[{"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] Acquired lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Refreshing network info cache for port 34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Start _get_guest_xml network_info=[{"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:32:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1353367570',display_name='tempest-VolumesAdminNegativeTest-server-1353367570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1353367570',id=23,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-3ooe36gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:32:46Z,user_data=None,user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=d3016724-0848-47b3-905e-c4f1700b14a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.objects.instance [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'pci_devices' on Instance uuid d3016724-0848-47b3-905e-c4f1700b14a3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:32:48 user nova-compute[75409]:   <uuid>d3016724-0848-47b3-905e-c4f1700b14a3</uuid>
Nov 15 21:32:48 user nova-compute[75409]:   <name>instance-00000017</name>
Nov 15 21:32:48 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:32:48 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:32:48 user nova-compute[75409]:   <metadata>
Nov 15 21:32:48 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:32:48 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1353367570</nova:name>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:32:48</nova:creationTime>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:32:48 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:32:48 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:owner>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:user uuid="a1dcb2c6a3fc42d08d6af32d01475751">tempest-VolumesAdminNegativeTest-399086255-project-member</nova:user>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:project uuid="ddec4e015c454beea9d9814218dad1c5">tempest-VolumesAdminNegativeTest-399086255</nova:project>
Nov 15 21:32:48 user nova-compute[75409]:       </nova:owner>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:32:48 user nova-compute[75409]:       <nova:ports>
Nov 15 21:32:48 user nova-compute[75409]:         <nova:port uuid="34b9f659-4301-4626-bbae-9676e903c33b">
Nov 15 21:32:48 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 21:32:48 user nova-compute[75409]:         </nova:port>
Nov 15 21:32:48 user nova-compute[75409]:       </nova:ports>
Nov 15 21:32:48 user nova-compute[75409]:     </nova:instance>
Nov 15 21:32:48 user nova-compute[75409]:   </metadata>
Nov 15 21:32:48 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:32:48 user nova-compute[75409]:     <system>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="serial">d3016724-0848-47b3-905e-c4f1700b14a3</entry>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="uuid">d3016724-0848-47b3-905e-c4f1700b14a3</entry>
Nov 15 21:32:48 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:32:48 user nova-compute[75409]:     </system>
Nov 15 21:32:48 user nova-compute[75409]:   </sysinfo>
Nov 15 21:32:48 user nova-compute[75409]:   <os>
Nov 15 21:32:48 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:32:48 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:32:48 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:32:48 user nova-compute[75409]:   </os>
Nov 15 21:32:48 user nova-compute[75409]:   <features>
Nov 15 21:32:48 user nova-compute[75409]:     <acpi/>
Nov 15 21:32:48 user nova-compute[75409]:     <apic/>
Nov 15 21:32:48 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:32:48 user nova-compute[75409]:   </features>
Nov 15 21:32:48 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:32:48 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:32:48 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:32:48 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:32:48 user nova-compute[75409]:   </clock>
Nov 15 21:32:48 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:32:48 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:32:48 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:32:48 user nova-compute[75409]:   </cpu>
Nov 15 21:32:48 user nova-compute[75409]:   <devices>
Nov 15 21:32:48 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:32:48 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:32:48 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk"/>
Nov 15 21:32:48 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:32:48 user nova-compute[75409]:     </disk>
Nov 15 21:32:48 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:32:48 user nova-compute[75409]:       <mac address="fa:16:3e:44:27:ee"/>
Nov 15 21:32:48 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:32:48 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:32:48 user nova-compute[75409]:       <target dev="tap34b9f659-43"/>
Nov 15 21:32:48 user nova-compute[75409]:     </interface>
Nov 15 21:32:48 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:32:48 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/console.log" append="off"/>
Nov 15 21:32:48 user nova-compute[75409]:     </serial>
Nov 15 21:32:48 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:32:48 user nova-compute[75409]:     <video>
Nov 15 21:32:48 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:32:48 user nova-compute[75409]:     </video>
Nov 15 21:32:48 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:32:48 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:32:48 user nova-compute[75409]:     </rng>
Nov 15 21:32:48 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:32:48 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:32:48 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:32:48 user nova-compute[75409]:     </memballoon>
Nov 15 21:32:48 user nova-compute[75409]:   </devices>
Nov 15 21:32:48 user nova-compute[75409]: </domain>
Nov 15 21:32:48 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1353367570',display_name='tempest-VolumesAdminNegativeTest-server-1353367570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1353367570',id=23,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-3ooe36gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:32:46Z,user_data=None,user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=d3016724-0848-47b3-905e-c4f1700b14a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG os_vif [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1e0a349-c640-5012-a729-00e3ddf20425', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34b9f659-43, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34b9f659-43, col_values=(('qos', UUID('1b08ca22-28b5-4ac9-a2e9-d6e068d2be67')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34b9f659-43, col_values=(('external_ids', {'iface-id': '34b9f659-4301-4626-bbae-9676e903c33b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:27:ee', 'vm-uuid': 'd3016724-0848-47b3-905e-c4f1700b14a3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:48 user nova-compute[75409]: INFO os_vif [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43')
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] No VIF found with MAC fa:16:3e:44:27:ee, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Updated VIF entry in instance network info cache for port 34b9f659-4301-4626-bbae-9676e903c33b. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Updating instance_info_cache with network_info: [{"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:32:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1fe5599b-b3f2-4506-bd6b-1a260eb67aa6 req-66f1e3ec-3583-45d6-b47c-d8a808f2f6df service nova] Releasing lock "refresh_cache-d3016724-0848-47b3-905e-c4f1700b14a3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] No waiting events found dispatching network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:49 user nova-compute[75409]: WARNING nova.compute.manager [req-a8a2dcf9-6463-4933-8a20-efa49b94bf5e req-97699f5c-7cb4-45bf-9774-836eadad7773 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received unexpected event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b for instance with vm_state building and task_state spawning.
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:32:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Instance spawned successfully.
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:32:51 user nova-compute[75409]: INFO nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 15 21:32:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:32:51 user nova-compute[75409]: INFO nova.compute.manager [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Took 6.45 seconds to build instance.
Nov 15 21:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58068fef-1b2f-4030-b20f-71e7df458a13 tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.869s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:32:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] No waiting events found dispatching network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:32:52 user nova-compute[75409]: WARNING nova.compute.manager [req-3d43ed83-cd1f-41a3-9bb7-187e4383d01b req-b89d06e7-b1b3-40a6-bf79-5d793f69dc4b service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received unexpected event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b for instance with vm_state active and task_state None.
Nov 15 21:32:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'flavor' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:32:55 user nova-compute[75409]: INFO nova.compute.manager [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Attaching volume 22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 to /dev/vdb
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.utils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e27cd52-3340-467a-8633-fa2f534a0377]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f8a2b-8b6d-4755-b246-404dbf4e90a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03857ae6-6da8-465e-9842-2b02b94dea7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948e25b-5afb-444f-84e7-48fb0ce23a3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:32:55 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:32:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d328c5f7-9353-4230-b168-20fb3293cd0b]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG os_brick.utils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:32:55 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating existing volume attachment record: 0122cd80-c09d-4df8-939d-f377f6a9d4d6 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:32:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:32:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:01 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260" returned: 21 in 0.107s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d9a32-afc2-4831-946c-90aeaeb64e3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:33:01 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd6a3c4-d49e-4873-b4d3-f3e0e20beb17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added
Nov 15 21:33:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c232f6e-a40b-4768-8fba-c7a82ffa11d0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415647c-a8fd-4f65-82be-4926029a65e6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7a2b5-6a76-48ce-a570-cda6647b816a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvCnEHGt'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a4a7bf-755b-44d7-91f3-f722d13ced60]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8aa370-1153-4a4a-8d80-4c1b8924a4ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:33:01 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:33:01 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:33:01 user nova-compute[75409]: 
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547b123-2da7-44d7-9dd9-653e6e52fa90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:33:01 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:33:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec4ad3-5bcc-4845-8bc2-5287b6393a9b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9a448-da91-4e56-8c56-d96326bfd8c5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428333b-000f-408b-ac31-792c6ccad525]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:33:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'flavor' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:33:02 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:33:02 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:33:02 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:33:02 user nova-compute[75409]:   <serial>22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2</serial>
Nov 15 21:33:02 user nova-compute[75409]: </disk>
Nov 15 21:33:02 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:33:02 user nova-compute[75409]: INFO nova.compute.claims [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Claim successful on node user
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No VIF found with MAC fa:16:3e:02:ec:b2, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:33:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d32fecb4-a510-4936-87d2-dd798a611bb5 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.463s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.policy [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cc4ebbfd85c43b78157cd50d8d4ef24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87098be8776c4e46abb1354048e23db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:33:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Creating image(s)
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.201s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.242s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk 1073741824" returned: 0 in 0.062s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.240s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Successfully created port: c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:04 user nova-compute[75409]: INFO nova.compute.manager [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Attaching volume 779e09a4-b008-496b-ab92-f85de58d6121 to /dev/vdb
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:33:04 user nova-compute[75409]: INFO nova.compute.claims [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Claim successful on node user
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Cannot resize image /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Ensure instance console log exists: /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8fab1-de3f-4625-8acc-50433773d36d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fae0a0-4f9c-4623-916e-b61ec87a0cef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b741aa-a3a6-476e-bc79-90b3d67e6912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[320594ea-8a1a-4917-9715-513368dc2ca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:33:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd0d98-a2c0-43ec-ae6d-0ae61d30c614]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating existing volume attachment record: effcc711-da8f-454f-bab5-bf555d8336ba {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:33:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG nova.policy [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cc4ebbfd85c43b78157cd50d8d4ef24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87098be8776c4e46abb1354048e23db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:33:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:33:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Creating image(s)
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Successfully updated port: c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Stashing vm_state: active {{(pid=75409) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.225s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:33:05 user nova-compute[75409]: INFO nova.compute.claims [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Claim successful on node user
Nov 15 21:33:05 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating resource usage from migration 2bba62bd-6ec0-4852-952a-5322c0a54469
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk 1073741824" returned: 0 in 0.058s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-changed-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Refreshing instance network info cache due to event network-changed-c3ccfd5c-9505-4387-b41c-b782d3722549. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Successfully created port: 896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance network_info: |[{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Refreshing network info cache for port c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start _get_guest_xml network_info=[{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:33:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.598s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:05 user nova-compute[75409]: INFO nova.compute.manager [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Migrating
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:33:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578225289',display_name='tempest-ServerRescueNegativeTestJSON-server-578225289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578225289',id=24,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-cx08850c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:03Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=270fd5bf-1d83-42f3-80b9-b92a5f29fcbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:06 user nova-compute[75409]: INFO nova.compute.rpcapi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Cannot resize image /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Ensure instance console log exists: /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:33:06 user nova-compute[75409]:   <uuid>270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</uuid>
Nov 15 21:33:06 user nova-compute[75409]:   <name>instance-00000018</name>
Nov 15 21:33:06 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:33:06 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:33:06 user nova-compute[75409]:   <metadata>
Nov 15 21:33:06 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:33:06 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578225289</nova:name>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:33:05</nova:creationTime>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:33:06 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:33:06 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:owner>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:33:06 user nova-compute[75409]:       </nova:owner>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:33:06 user nova-compute[75409]:       <nova:ports>
Nov 15 21:33:06 user nova-compute[75409]:         <nova:port uuid="c3ccfd5c-9505-4387-b41c-b782d3722549">
Nov 15 21:33:06 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:33:06 user nova-compute[75409]:         </nova:port>
Nov 15 21:33:06 user nova-compute[75409]:       </nova:ports>
Nov 15 21:33:06 user nova-compute[75409]:     </nova:instance>
Nov 15 21:33:06 user nova-compute[75409]:   </metadata>
Nov 15 21:33:06 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:33:06 user nova-compute[75409]:     <system>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="serial">270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</entry>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="uuid">270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</entry>
Nov 15 21:33:06 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:33:06 user nova-compute[75409]:     </system>
Nov 15 21:33:06 user nova-compute[75409]:   </sysinfo>
Nov 15 21:33:06 user nova-compute[75409]:   <os>
Nov 15 21:33:06 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:33:06 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:33:06 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:33:06 user nova-compute[75409]:   </os>
Nov 15 21:33:06 user nova-compute[75409]:   <features>
Nov 15 21:33:06 user nova-compute[75409]:     <acpi/>
Nov 15 21:33:06 user nova-compute[75409]:     <apic/>
Nov 15 21:33:06 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:33:06 user nova-compute[75409]:   </features>
Nov 15 21:33:06 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:33:06 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:33:06 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:33:06 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:33:06 user nova-compute[75409]:   </clock>
Nov 15 21:33:06 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:33:06 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:33:06 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:33:06 user nova-compute[75409]:   </cpu>
Nov 15 21:33:06 user nova-compute[75409]:   <devices>
Nov 15 21:33:06 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:33:06 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:33:06 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk"/>
Nov 15 21:33:06 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:33:06 user nova-compute[75409]:     </disk>
Nov 15 21:33:06 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:33:06 user nova-compute[75409]:       <mac address="fa:16:3e:a9:23:6b"/>
Nov 15 21:33:06 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:06 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:33:06 user nova-compute[75409]:       <target dev="tapc3ccfd5c-95"/>
Nov 15 21:33:06 user nova-compute[75409]:     </interface>
Nov 15 21:33:06 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:33:06 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/console.log" append="off"/>
Nov 15 21:33:06 user nova-compute[75409]:     </serial>
Nov 15 21:33:06 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:33:06 user nova-compute[75409]:     <video>
Nov 15 21:33:06 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:06 user nova-compute[75409]:     </video>
Nov 15 21:33:06 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:33:06 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:33:06 user nova-compute[75409]:     </rng>
Nov 15 21:33:06 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:33:06 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:33:06 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:33:06 user nova-compute[75409]:     </memballoon>
Nov 15 21:33:06 user nova-compute[75409]:   </devices>
Nov 15 21:33:06 user nova-compute[75409]: </domain>
Nov 15 21:33:06 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578225289',display_name='tempest-ServerRescueNegativeTestJSON-server-578225289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578225289',id=24,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-cx08850c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:03Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=270fd5bf-1d83-42f3-80b9-b92a5f29fcbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG os_vif [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b9208e9-2509-5e13-98c4-724ad00f6b36', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3ccfd5c-95, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3ccfd5c-95, col_values=(('qos', UUID('36f6fe69-ed1e-4a1e-acf9-0c1917e4152e')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3ccfd5c-95, col_values=(('external_ids', {'iface-id': 'c3ccfd5c-9505-4387-b41c-b782d3722549', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:23:6b', 'vm-uuid': '270fd5bf-1d83-42f3-80b9-b92a5f29fcbd'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:06 user nova-compute[75409]: INFO os_vif [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95')
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:a9:23:6b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updated VIF entry in instance network info cache for port c3ccfd5c-9505-4387-b41c-b782d3722549. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0d1900-2878-411e-8843-0ec02776bd86 req-ebd3fabc-f1ea-4146-9298-17ecfc20446d service nova] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Successfully updated port: 896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Starting migrate_disk_and_power_off {{(pid=75409) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance network_info: |[{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start _get_guest_xml network_info=[{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1141366530',display_name='tempest-ServerRescueNegativeTestJSON-server-1141366530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1141366530',id=25,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-x7wx0rvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:05Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=dc80da1c-5f06-44c8-bf8b-2406c22b9d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-changed-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Refreshing instance network info cache due to event network-changed-896cbe20-15ce-4be9-9b16-c08d3d92a70b. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] Acquiring lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] Acquired lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.neutron [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Refreshing network info cache for port 896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:33:07 user nova-compute[75409]:   <uuid>dc80da1c-5f06-44c8-bf8b-2406c22b9d73</uuid>
Nov 15 21:33:07 user nova-compute[75409]:   <name>instance-00000019</name>
Nov 15 21:33:07 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:33:07 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:33:07 user nova-compute[75409]:   <metadata>
Nov 15 21:33:07 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:33:07 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1141366530</nova:name>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:33:07</nova:creationTime>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:33:07 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:33:07 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:owner>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:33:07 user nova-compute[75409]:       </nova:owner>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:33:07 user nova-compute[75409]:       <nova:ports>
Nov 15 21:33:07 user nova-compute[75409]:         <nova:port uuid="896cbe20-15ce-4be9-9b16-c08d3d92a70b">
Nov 15 21:33:07 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 21:33:07 user nova-compute[75409]:         </nova:port>
Nov 15 21:33:07 user nova-compute[75409]:       </nova:ports>
Nov 15 21:33:07 user nova-compute[75409]:     </nova:instance>
Nov 15 21:33:07 user nova-compute[75409]:   </metadata>
Nov 15 21:33:07 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:33:07 user nova-compute[75409]:     <system>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="serial">dc80da1c-5f06-44c8-bf8b-2406c22b9d73</entry>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="uuid">dc80da1c-5f06-44c8-bf8b-2406c22b9d73</entry>
Nov 15 21:33:07 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:33:07 user nova-compute[75409]:     </system>
Nov 15 21:33:07 user nova-compute[75409]:   </sysinfo>
Nov 15 21:33:07 user nova-compute[75409]:   <os>
Nov 15 21:33:07 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:33:07 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:33:07 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:33:07 user nova-compute[75409]:   </os>
Nov 15 21:33:07 user nova-compute[75409]:   <features>
Nov 15 21:33:07 user nova-compute[75409]:     <acpi/>
Nov 15 21:33:07 user nova-compute[75409]:     <apic/>
Nov 15 21:33:07 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:33:07 user nova-compute[75409]:   </features>
Nov 15 21:33:07 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:33:07 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:33:07 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:33:07 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:33:07 user nova-compute[75409]:   </clock>
Nov 15 21:33:07 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:33:07 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:33:07 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:33:07 user nova-compute[75409]:   </cpu>
Nov 15 21:33:07 user nova-compute[75409]:   <devices>
Nov 15 21:33:07 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:33:07 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:33:07 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk"/>
Nov 15 21:33:07 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:33:07 user nova-compute[75409]:     </disk>
Nov 15 21:33:07 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:33:07 user nova-compute[75409]:       <mac address="fa:16:3e:92:6a:62"/>
Nov 15 21:33:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:07 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:33:07 user nova-compute[75409]:       <target dev="tap896cbe20-15"/>
Nov 15 21:33:07 user nova-compute[75409]:     </interface>
Nov 15 21:33:07 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:33:07 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/console.log" append="off"/>
Nov 15 21:33:07 user nova-compute[75409]:     </serial>
Nov 15 21:33:07 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:33:07 user nova-compute[75409]:     <video>
Nov 15 21:33:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:07 user nova-compute[75409]:     </video>
Nov 15 21:33:07 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:33:07 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:33:07 user nova-compute[75409]:     </rng>
Nov 15 21:33:07 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:33:07 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:33:07 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:33:07 user nova-compute[75409]:     </memballoon>
Nov 15 21:33:07 user nova-compute[75409]:   </devices>
Nov 15 21:33:07 user nova-compute[75409]: </domain>
Nov 15 21:33:07 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1141366530',display_name='tempest-ServerRescueNegativeTestJSON-server-1141366530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1141366530',id=25,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-x7wx0rvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:05Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=dc80da1c-5f06-44c8-bf8b-2406c22b9d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG os_vif [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10cb4c86-50d7-573f-8c0f-cef59dc2f03a', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896cbe20-15, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap896cbe20-15, col_values=(('qos', UUID('cebc8b83-52ca-49a9-9803-e45b0f77cd09')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap896cbe20-15, col_values=(('external_ids', {'iface-id': '896cbe20-15ce-4be9-9b16-c08d3d92a70b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:6a:62', 'vm-uuid': 'dc80da1c-5f06-44c8-bf8b-2406c22b9d73'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:07 user nova-compute[75409]: INFO os_vif [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15')
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:07 user nova-compute[75409]: WARNING nova.compute.manager [req-bc8bb576-2519-4fed-a1c7-2104796362c6 req-b623904a-f61c-4403-bfd9-74303f02de9a service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state active and task_state resize_migrating.
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:92:6a:62, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.network.neutron [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updated VIF entry in instance network info cache for port 896cbe20-15ce-4be9-9b16-c08d3d92a70b. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.network.neutron [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f228dd9f-4e61-4378-b05f-8a21a6fb4572 req-c65f0c31-29aa-4d79-8ad0-8a6fc00fc084 service nova] Releasing lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance destroyed successfully.
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c9dd991-67, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f95c77e3-55f0-42d6-9bb5-af3132138a28) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: INFO os_vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:08 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02337d3c-edf6-4ca2-af48-cb7d11cd19ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:33:08 user nova-compute[75409]: No targets found.
Nov 15 21:33:08 user nova-compute[75409]: iSNS:
Nov 15 21:33:08 user nova-compute[75409]: No targets found.
Nov 15 21:33:08 user nova-compute[75409]: STATIC:
Nov 15 21:33:08 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:33:08 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:33:08 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:33:08 user nova-compute[75409]: FIRMWARE:
Nov 15 21:33:08 user nova-compute[75409]: No targets found.
Nov 15 21:33:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:33:08 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:33:08 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9185fb84-2646-4343-b51a-dc787616f8bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[976fbbe0-8393-4793-a9ea-e1a2624b6072]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28505120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd86853-b03b-4173-9a72-d6d7faff7dad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[51383112-a840-4fcc-8803-a0948a65ca5c]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ea3f3-4457-4b3d-beec-775cca4af6b9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d73ce4-39de-41a7-b6da-3bb72e010128]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef87ec2-6c47-4fe3-8c8a-17b01dcfd791]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af272149-2a20-4335-8312-d155f8107ee3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:33:08 user nova-compute[75409]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:33:08 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7aab65-e6bc-4d1c-90ff-fbdaa6f3c386]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== disconnect_volume: return (331ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:33:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_resize/disk /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "cp -r /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_resize/disk /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk" returned: 0 in 0.363s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_resize/disk.info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk.info {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state building and task_state spawning.
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING nova.compute.manager [req-b57e438e-6255-4e9e-8f64-77b41dc91a05 req-ac0437e3-a193-425e-8cee-752b58b5e569 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state building and task_state spawning.
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "cp -r /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_resize/disk.info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk.info" returned: 0 in 0.066s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state active and task_state resize_migrating.
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING nova.compute.manager [req-2e1854d3-b3f7-42f6-a7ce-ded7405ec86a req-4bc85e07-d87f-4521-8265-73c404b95399 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state building and task_state spawning.
Nov 15 21:33:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlWcZzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:09 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8484dd3d-7494-4978-86fe-5a15e63bea7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:33:09 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b45d3e-705a-4dbe-9be8-9c8065ba8f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121] added
Nov 15 21:33:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d514509-5ca1-4e45-b543-202417fbf5fc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00485a-1c70-4245-a6d5-a6b381c1d20e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlWcZzKs {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlWcZzKs" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d4d0a1-727b-473c-ae2a-84b9806ae928]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlWcZzKs'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7a6d2-ee58-4cf8-8b89-13aee73a382c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff0f7c-e35f-48fa-9ca5-0e5614abb70f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:33:10 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:33:10 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:33:10 user nova-compute[75409]: 
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a88e071-58f3-44e9-b047-486974de5ae0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260]
Nov 15 21:33:10 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260] successful.
Nov 15 21:33:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b673a-246e-42d0-8168-4ed0efd2a4c3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f1716-de0c-4bf7-8ae9-041ff352816b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c587e2f6-b8ab-405f-8b1b-6391ba2f9dac]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlWcZzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Port 2c9dd991-6743-45f3-af24-cd08422d3843 binding to destination host user is already ACTIVE {{(pid=75409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance spawned successfully.
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:11 user nova-compute[75409]: INFO nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:11 user nova-compute[75409]: INFO nova.compute.manager [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Took 8.62 seconds to build instance.
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eb38400a-058a-4900-aba9-a157a0e49f9f tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.744s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23433306335373034', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433306335373034', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:33:11 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:33:11 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:33:11 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:33:11 user nova-compute[75409]:   <serial>779e09a4-b008-496b-ab92-f85de58d6121</serial>
Nov 15 21:33:11 user nova-compute[75409]: </disk>
Nov 15 21:33:11 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.utils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7163cc05-9b3f-4761-85c5-1bd0d6f83c39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df15a9-1899-4961-ad3c-7b01b25e9e73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e0aa1-47da-44f9-a722-6e0ec0d4b1d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108d0a5-61e9-40df-a807-8b7183b80f1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:33:11 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77909b3f-5578-4912-bdaa-04e46908e9d3]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG os_brick.utils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] No VIF found with MAC fa:16:3e:a8:66:00, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:33:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance spawned successfully.
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:11 user nova-compute[75409]: WARNING nova.compute.manager [req-e4f6ff6b-ace8-4a5e-a40e-3e8d3525406f req-ae821833-ebd8-4f6a-aad5-33729d271ddb service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state building and task_state spawning.
Nov 15 21:33:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4d316b93-27d5-407f-90a6-dd3f7893bb20 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.716s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:11 user nova-compute[75409]: INFO nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 15 21:33:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:11 user nova-compute[75409]: INFO nova.compute.manager [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Took 7.87 seconds to build instance.
Nov 15 21:33:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-44054a94-d250-44a4-81fa-cfd377fb10a4 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.021s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-changed-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing instance network info cache due to event network-changed-7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing network info cache for port 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updated VIF entry in instance network info cache for port 7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c8d2e81f-3d08-4c63-b5cf-9305d7b360e8 req-67239d03-652e-400b-ad05-36c921e863db service nova] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Starting finish_migration {{(pid=75409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:33:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Creating image(s)
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.222s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk. size=21474836480 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-changed-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing instance network info cache due to event network-changed-7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing network info cache for port 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk 21474836480 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk 21474836480" returned: 0 in 0.297s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Ensure instance console log exists: /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start _get_guest_xml network_info=[{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ff35ef10-9b97-4082-bf02-8fa4d9db9063', 'attached_at': '2023-11-15T21:33:17.000000', 'detached_at': '', 'volume_id': '22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'serial': '22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '73a7643b-2f71-4ff5-883d-ee09886991fb', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:33:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:33:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:33:18 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:18 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:33:18 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccaa8d6-8f2a-41ea-81ac-a4f435e4e7f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:33:18 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aea2d9-317b-4fb7-b419-c4267bb1e095]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6120d7db-80d9-4107-9f70-ba3623fa88fb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2b1ffd-bf88-441c-975c-f009a321dcee]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a491447b-0123-46ae-a4ca-cdaa64ba71d0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvCnEHGt'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updated VIF entry in instance network info cache for port 7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c5864-ef5a-4387-8584-b335d1878324]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-41016f93-9158-4d91-8135-979195243dc4 req-b9e3d01c-51de-44df-aa37-28ba30270c45 service nova] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:18 user nova-compute[75409]: INFO nova.compute.manager [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Rebooting instance
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790453b-b5e7-40b4-ba78-c386255981b9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e7e4f-3a00-49c9-ab66-5d1144100a23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:33:18 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd66ce-88f0-4c9b-ade1-e2dbe3fae9c8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed63b5e-0526-4cab-961e-46ba2928b178]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:33:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a5663-726d-463c-8f8d-dab666cb6f4f]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:33:19 user nova-compute[75409]:   <uuid>ff35ef10-9b97-4082-bf02-8fa4d9db9063</uuid>
Nov 15 21:33:19 user nova-compute[75409]:   <name>instance-00000010</name>
Nov 15 21:33:19 user nova-compute[75409]:   <memory>2097152</memory>
Nov 15 21:33:19 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:33:19 user nova-compute[75409]:   <metadata>
Nov 15 21:33:19 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:33:19 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherB-server-405583289</nova:name>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:33:17</nova:creationTime>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:flavor name="m1.small">
Nov 15 21:33:19 user nova-compute[75409]:         <nova:memory>2048</nova:memory>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:disk>20</nova:disk>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:33:19 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:owner>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:user uuid="53d5e54d2abc4dd78b4b18e002ddbd96">tempest-ServerActionsTestOtherB-729308147-project-member</nova:user>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:project uuid="b0c5836aea124274a11f184cdb783429">tempest-ServerActionsTestOtherB-729308147</nova:project>
Nov 15 21:33:19 user nova-compute[75409]:       </nova:owner>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:33:19 user nova-compute[75409]:       <nova:ports>
Nov 15 21:33:19 user nova-compute[75409]:         <nova:port uuid="2c9dd991-6743-45f3-af24-cd08422d3843">
Nov 15 21:33:19 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:33:19 user nova-compute[75409]:         </nova:port>
Nov 15 21:33:19 user nova-compute[75409]:       </nova:ports>
Nov 15 21:33:19 user nova-compute[75409]:     </nova:instance>
Nov 15 21:33:19 user nova-compute[75409]:   </metadata>
Nov 15 21:33:19 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:33:19 user nova-compute[75409]:     <system>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="serial">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="uuid">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:33:19 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:33:19 user nova-compute[75409]:     </system>
Nov 15 21:33:19 user nova-compute[75409]:   </sysinfo>
Nov 15 21:33:19 user nova-compute[75409]:   <os>
Nov 15 21:33:19 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:33:19 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:33:19 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:33:19 user nova-compute[75409]:   </os>
Nov 15 21:33:19 user nova-compute[75409]:   <features>
Nov 15 21:33:19 user nova-compute[75409]:     <acpi/>
Nov 15 21:33:19 user nova-compute[75409]:     <apic/>
Nov 15 21:33:19 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:33:19 user nova-compute[75409]:   </features>
Nov 15 21:33:19 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:33:19 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:33:19 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:33:19 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:33:19 user nova-compute[75409]:   </clock>
Nov 15 21:33:19 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:33:19 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:33:19 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:33:19 user nova-compute[75409]:   </cpu>
Nov 15 21:33:19 user nova-compute[75409]:   <devices>
Nov 15 21:33:19 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:33:19 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:33:19 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk"/>
Nov 15 21:33:19 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:33:19 user nova-compute[75409]:     </disk>
Nov 15 21:33:19 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:33:19 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:33:19 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:33:19 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:33:19 user nova-compute[75409]:       <serial>22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2</serial>
Nov 15 21:33:19 user nova-compute[75409]:     </disk>
Nov 15 21:33:19 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:33:19 user nova-compute[75409]:       <mac address="fa:16:3e:02:ec:b2"/>
Nov 15 21:33:19 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:19 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:33:19 user nova-compute[75409]:       <target dev="tap2c9dd991-67"/>
Nov 15 21:33:19 user nova-compute[75409]:     </interface>
Nov 15 21:33:19 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:33:19 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/console.log" append="off"/>
Nov 15 21:33:19 user nova-compute[75409]:     </serial>
Nov 15 21:33:19 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:33:19 user nova-compute[75409]:     <video>
Nov 15 21:33:19 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:19 user nova-compute[75409]:     </video>
Nov 15 21:33:19 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:33:19 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:33:19 user nova-compute[75409]:     </rng>
Nov 15 21:33:19 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:33:19 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:33:19 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:33:19 user nova-compute[75409]:     </memballoon>
Nov 15 21:33:19 user nova-compute[75409]:   </devices>
Nov 15 21:33:19 user nova-compute[75409]: </domain>
Nov 15 21:33:19 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-623261240-network", "vif_mac": "fa:16:3e:02:ec:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG os_vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3facbe5a-89ea-5d39-97a0-0a2e891fabc2', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c9dd991-67, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c9dd991-67, col_values=(('qos', UUID('1a61d56a-4f70-4353-a7f7-f9c27200e9b1')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c9dd991-67, col_values=(('external_ids', {'iface-id': '2c9dd991-6743-45f3-af24-cd08422d3843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ec:b2', 'vm-uuid': 'ff35ef10-9b97-4082-bf02-8fa4d9db9063'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:19 user nova-compute[75409]: INFO os_vif [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] No VIF found with MAC fa:16:3e:02:ec:b2, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:21 user nova-compute[75409]: WARNING nova.compute.manager [req-4649d222-b2b1-454f-8349-b2dee7a1e27b req-0d634c57-a48a-48d8-b15c-f4858330d658 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state active and task_state resize_finish.
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:21 user nova-compute[75409]: WARNING nova.compute.manager [req-7adcd085-032e-43a4-8050-4b39efdd4c85 req-bbc41d54-8f91-4978-9333-0b2e30358929 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state active and task_state reboot_started.
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance shutdown successfully.
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:23 user nova-compute[75409]: WARNING nova.compute.manager [req-0d8afbd5-f3cd-4bbf-8281-485b5e5f39f5 req-02cf0a45-b19a-450d-8158-b68ac141072f service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state active and task_state resize_finish.
Nov 15 21:33:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:33:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance running successfully.
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Failed to set time: agent not configured {{(pid=75409) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-59143c7a-e294-4a05-bba6-8bca8b55a3fb tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] finish_migration finished successfully. {{(pid=75409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:23 user nova-compute[75409]: DEBUG nova.compute.manager [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:23 user nova-compute[75409]: WARNING nova.compute.manager [req-4ad09bae-dd3c-4530-92df-4de1880601c2 req-96b7e951-a5b5-4d8c-8cf3-ebb17791344b service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state active and task_state reboot_started.
Nov 15 21:33:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:25 user nova-compute[75409]: WARNING nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state active and task_state reboot_started.
Nov 15 21:33:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:25 user nova-compute[75409]: WARNING nova.compute.manager [req-4d8ab487-f62f-4164-bd8d-c2a3f58545cc req-8a543502-6582-4473-a4b2-f1089799dcb6 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state active and task_state reboot_started.
Nov 15 21:33:25 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance running successfully.
Nov 15 21:33:25 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance soft rebooted successfully.
Nov 15 21:33:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9af5eb56-8979-4837-838f-9e04dc56f158 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.884s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:33:29 user nova-compute[75409]: INFO nova.compute.claims [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Claim successful on node user
Nov 15 21:33:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:33:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.policy [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae40e5bccb84c50a4c93963d56469f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d130f253b745e2ac2497eebbd4cf99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:33:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Creating image(s)
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.303s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.255s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk 1073741824" returned: 0 in 0.096s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Successfully created port: 3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.285s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Cannot resize image /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Ensure instance console log exists: /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Successfully updated port: 3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-changed-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Refreshing instance network info cache due to event network-changed-3a014045-0efc-4989-a690-a3af9b14cc48. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] Acquiring lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating instance_info_cache with network_info: [{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance network_info: |[{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] Acquired lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Refreshing network info cache for port 3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start _get_guest_xml network_info=[{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:33:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-tempest.common.compute-instance-149324729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'pci_devices' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:33:32 user nova-compute[75409]:   <uuid>ee81e967-0218-462c-adb0-fb459b0cad43</uuid>
Nov 15 21:33:32 user nova-compute[75409]:   <name>instance-0000001a</name>
Nov 15 21:33:32 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:33:32 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:33:32 user nova-compute[75409]:   <metadata>
Nov 15 21:33:32 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:33:32 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:name>tempest-tempest.common.compute-instance-149324729</nova:name>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:33:32</nova:creationTime>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:33:32 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:33:32 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:owner>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:user uuid="4ae40e5bccb84c50a4c93963d56469f9">tempest-ServerActionsTestOtherA-1526007087-project-member</nova:user>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:project uuid="a8d130f253b745e2ac2497eebbd4cf99">tempest-ServerActionsTestOtherA-1526007087</nova:project>
Nov 15 21:33:32 user nova-compute[75409]:       </nova:owner>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:33:32 user nova-compute[75409]:       <nova:ports>
Nov 15 21:33:32 user nova-compute[75409]:         <nova:port uuid="3a014045-0efc-4989-a690-a3af9b14cc48">
Nov 15 21:33:32 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 21:33:32 user nova-compute[75409]:         </nova:port>
Nov 15 21:33:32 user nova-compute[75409]:       </nova:ports>
Nov 15 21:33:32 user nova-compute[75409]:     </nova:instance>
Nov 15 21:33:32 user nova-compute[75409]:   </metadata>
Nov 15 21:33:32 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:33:32 user nova-compute[75409]:     <system>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="serial">ee81e967-0218-462c-adb0-fb459b0cad43</entry>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="uuid">ee81e967-0218-462c-adb0-fb459b0cad43</entry>
Nov 15 21:33:32 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:33:32 user nova-compute[75409]:     </system>
Nov 15 21:33:32 user nova-compute[75409]:   </sysinfo>
Nov 15 21:33:32 user nova-compute[75409]:   <os>
Nov 15 21:33:32 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:33:32 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:33:32 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:33:32 user nova-compute[75409]:   </os>
Nov 15 21:33:32 user nova-compute[75409]:   <features>
Nov 15 21:33:32 user nova-compute[75409]:     <acpi/>
Nov 15 21:33:32 user nova-compute[75409]:     <apic/>
Nov 15 21:33:32 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:33:32 user nova-compute[75409]:   </features>
Nov 15 21:33:32 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:33:32 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:33:32 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:33:32 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:33:32 user nova-compute[75409]:   </clock>
Nov 15 21:33:32 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:33:32 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:33:32 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:33:32 user nova-compute[75409]:   </cpu>
Nov 15 21:33:32 user nova-compute[75409]:   <devices>
Nov 15 21:33:32 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:33:32 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:33:32 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk"/>
Nov 15 21:33:32 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:33:32 user nova-compute[75409]:     </disk>
Nov 15 21:33:32 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:33:32 user nova-compute[75409]:       <mac address="fa:16:3e:ee:c8:e8"/>
Nov 15 21:33:32 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:32 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:33:32 user nova-compute[75409]:       <target dev="tap3a014045-0e"/>
Nov 15 21:33:32 user nova-compute[75409]:     </interface>
Nov 15 21:33:32 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:33:32 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/console.log" append="off"/>
Nov 15 21:33:32 user nova-compute[75409]:     </serial>
Nov 15 21:33:32 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:33:32 user nova-compute[75409]:     <video>
Nov 15 21:33:32 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:33:32 user nova-compute[75409]:     </video>
Nov 15 21:33:32 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:33:32 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:33:32 user nova-compute[75409]:     </rng>
Nov 15 21:33:32 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:33:32 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:33:32 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:33:32 user nova-compute[75409]:     </memballoon>
Nov 15 21:33:32 user nova-compute[75409]:   </devices>
Nov 15 21:33:32 user nova-compute[75409]: </domain>
Nov 15 21:33:32 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-tempest.common.compute-instance-149324729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG os_vif [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db20e401-473d-5b4c-8201-3fec9a45d8f3', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a014045-0e, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a014045-0e, col_values=(('qos', UUID('f07617e8-fad3-4618-8800-f8b69e90bc27')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a014045-0e, col_values=(('external_ids', {'iface-id': '3a014045-0efc-4989-a690-a3af9b14cc48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:c8:e8', 'vm-uuid': 'ee81e967-0218-462c-adb0-fb459b0cad43'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:32 user nova-compute[75409]: INFO os_vif [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e')
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:ee:c8:e8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updated VIF entry in instance network info cache for port 3a014045-0efc-4989-a690-a3af9b14cc48. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating instance_info_cache with network_info: [{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c7078ecd-ed40-478c-a0dc-cb8eeb87e019 req-c14afd25-2eb7-4709-8d4f-be768a3800fc service nova] Releasing lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:34 user nova-compute[75409]: WARNING nova.compute.manager [req-699dd597-ca5c-407e-876a-3d1b9a5d4b2d req-9522dbab-e545-4416-8e72-5028230bc73f service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state building and task_state spawning.
Nov 15 21:33:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:33:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance spawned successfully.
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:36 user nova-compute[75409]: WARNING nova.compute.manager [req-ed05db93-2bef-457a-871a-e258ff65a3e7 req-676d1485-a315-4c71-a0fd-4f6dc46f8924 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state building and task_state spawning.
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:33:36 user nova-compute[75409]: INFO nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 15 21:33:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:36 user nova-compute[75409]: INFO nova.compute.manager [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Took 7.20 seconds to build instance.
Nov 15 21:33:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbe322ba-9a9a-40bb-848d-1ee541df6014 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.306s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:33:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:33:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.132705688476562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Applying migration context for instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 as it has an incoming, in-progress migration 2bba62bd-6ec0-4852-952a-5322c0a54469. Migration status is finished {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 21:33:49 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating resource usage from migration 2bba62bd-6ec0-4852-952a-5322c0a54469
Nov 15 21:33:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dd6c324b-f505-4391-813d-1534b5ed11ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77526585-a92a-411a-ad4b-ddf79ef1a3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d3016724-0848-47b3-905e-c4f1700b14a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Migration 2bba62bd-6ec0-4852-952a-5322c0a54469 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:33:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing instance network info cache due to event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:52 user nova-compute[75409]: DEBUG nova.network.neutron [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updated VIF entry in instance network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:52 user nova-compute[75409]: DEBUG nova.network.neutron [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0e22c05a-6d6b-4232-8182-9721aff89e3f req-96cd8ee2-1517-4d6e-90a6-b47e2a07ae24 service nova] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:53 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:33:53 user nova-compute[75409]: INFO nova.compute.claims [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Claim successful on node user
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:33:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG nova.policy [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:33:54 user nova-compute[75409]: INFO nova.virt.block_device [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Booting with volume snapshot add0a85b-f922-4e81-a7cf-4339b2a5fecc at /dev/vda
Nov 15 21:33:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:54 user nova-compute[75409]: INFO nova.compute.manager [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Shelving
Nov 15 21:33:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:55 user nova-compute[75409]: WARNING nova.compute.manager [req-4d8675ef-1736-486f-a02d-cffda6e24cc2 req-7446034a-bdad-4f58-b31e-2977b0b4c68c service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state active and task_state shelving.
Nov 15 21:33:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance destroyed successfully.
Nov 15 21:33:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Beginning cold snapshot process
Nov 15 21:33:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Successfully created port: f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:33:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk /opt/stack/data/nova/instances/snapshots/tmp8ldo7o_i/65c08892d32e4ba3922f9532eb455475 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Successfully updated port: f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk /opt/stack/data/nova/instances/snapshots/tmp8ldo7o_i/65c08892d32e4ba3922f9532eb455475" returned: 0 in 0.962s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:33:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Snapshot extracted, beginning image upload
Nov 15 21:33:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Updating instance_info_cache with network_info: [{"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Instance network_info: |[{"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:33:57 user nova-compute[75409]: WARNING nova.compute.manager [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-changed-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Refreshing instance network info cache due to event network-changed-f86cfde7-ab44-42eb-9026-5708668d09a2. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Acquiring lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Acquired lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Refreshing network info cache for port f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Updated VIF entry in instance network info cache for port f86cfde7-ab44-42eb-9026-5708668d09a2. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Updating instance_info_cache with network_info: [{"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac505e27-3367-4b56-b5c4-213e5d2ba84b req-81b93314-0430-4d94-8afe-f2a873d36fbd service nova] Releasing lock "refresh_cache-5a44b25c-2877-4f3b-983c-26ad04878629" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:58 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Snapshot image upload complete
Nov 15 21:33:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:59 user nova-compute[75409]: INFO nova.compute.manager [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Shelve offloading
Nov 15 21:33:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance destroyed successfully.
Nov 15 21:33:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:33:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance destroyed successfully.
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'resources' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing instance network info cache due to event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj9lkJ6JzRsVuY9EzWH5rwqPrEhaA7v1OPNfnzbdOycYveda2BsQWNpXeLTQvoXJfAFhKfsnDcixZPRU8xSSStrOo3gtyKqlf2Vlrw1iUYt0iSxmaULBDrmr++uYHaSkA==',key_name='tempest-keypair-867532891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:33:58.977134',shelved_host='user',shelved_image_id='a03f87b5-dabf-4455-b70b-f8e240168222'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_vif [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.utils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap143fa542-7e, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fbe87b-92b6-4417-941e-9b17fb94e797]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4cdf62c-724c-48df-9e01-aabe00b3a8b1) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:00 user nova-compute[75409]: INFO os_vif [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e')
Nov 15 21:34:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Deleting instance files /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4_del
Nov 15 21:34:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Deletion of /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4_del complete
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c6a5a-e0a4-4602-92c1-5ddee3ab615a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b0e50-143a-446b-828e-31aa81110a4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddcf6d9-69f8-401c-8dd3-ff81e6191774]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:34:00 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f7f2c-fd57-4fcb-adbe-09bbd9de0267]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG os_brick.utils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Updating existing volume attachment record: 7fecce5a-54e3-4edb-8962-6a1e63a8f8d0 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:34:00 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Deleted allocations for instance 77526585-a92a-411a-ad4b-ddf79ef1a3c4
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'numa_topology' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.objects.base [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77526585-a92a-411a-ad4b-ddf79ef1a3c4> lazy-loaded attributes: resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updated VIF entry in instance network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap143fa542-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-570888a7-9c4b-41f2-ae65-29038ef39e4e req-98490093-2865-4cc6-b1e4-fa53464aff0f service nova] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2334d126-9355-4f7b-a661-4016912fef54 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.375s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:34:05 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Creating image(s)
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Ensure instance console log exists: /opt/stack/data/nova/instances/5a44b25c-2877-4f3b-983c-26ad04878629/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Start _get_guest_xml network_info=[{"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfDudgMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a44b25c-2877-4f3b-983c-26ad04878629', 'attached_at': '', 'detached_at': '', 'volume_id': 'd86232bb-cd44-4189-a28d-bca6674a42fe', 'serial': 'd86232bb-cd44-4189-a28d-bca6674a42fe'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '7fecce5a-54e3-4edb-8962-6a1e63a8f8d0', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:34:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfDudgMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:34:05 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:34:05 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:34:05 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3112bea-01d7-4c31-83c7-e7758c59caa8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:34:05 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c37dc-74f1-4152-9b88-a1e3fc413a94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe] added
Nov 15 21:34:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b9d0b-8dfc-4eb9-bf58-15a261f0225f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4780ba4-deb0-46ae-9984-00108b2bb717]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfDudgMX {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfDudgMX" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4223868-c293-44d2-9102-cf9b46c41bff]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfDudgMX'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2b107-b697-430a-ada6-7d573c837f11]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a2877-cd7c-4396-a635-fbb2e781f226]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:05 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:05 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9d6fd-fc65-449e-8d57-f86797c002b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260]
Nov 15 21:34:05 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260] successful.
Nov 15 21:34:05 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5371ad-468b-402a-8b46-b5d007656860]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc8ddf1-46d1-4aeb-bfc5-f316cc1cb6a2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:06 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:06 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:34:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:06 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:06 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:34:06 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395c58d-470c-4482-a96a-1187e967afbf]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:06 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfDudgMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26134653931616332', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653931616332', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633188246',display_name='tempest-TestVolumeBootPattern-server-633188246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633188246',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0uguwpof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:54Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=5a44b25c-2877-4f3b-983c-26ad04878629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a44b25c-2877-4f3b-983c-26ad04878629 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:34:07 user nova-compute[75409]:   <uuid>5a44b25c-2877-4f3b-983c-26ad04878629</uuid>
Nov 15 21:34:07 user nova-compute[75409]:   <name>instance-0000001b</name>
Nov 15 21:34:07 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:34:07 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:34:07 user nova-compute[75409]:   <metadata>
Nov 15 21:34:07 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:34:07 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:34:07 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-server-633188246</nova:name>
Nov 15 21:34:07 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:34:05</nova:creationTime>
Nov 15 21:34:07 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:34:07 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:34:07 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:34:07 user nova-compute[75409]:       <nova:owner>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:34:07 user nova-compute[75409]:       </nova:owner>
Nov 15 21:34:07 user nova-compute[75409]:       <nova:ports>
Nov 15 21:34:07 user nova-compute[75409]:         <nova:port uuid="f86cfde7-ab44-42eb-9026-5708668d09a2">
Nov 15 21:34:07 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:34:07 user nova-compute[75409]:         </nova:port>
Nov 15 21:34:07 user nova-compute[75409]:       </nova:ports>
Nov 15 21:34:07 user nova-compute[75409]:     </nova:instance>
Nov 15 21:34:07 user nova-compute[75409]:   </metadata>
Nov 15 21:34:07 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:34:07 user nova-compute[75409]:     <system>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="serial">5a44b25c-2877-4f3b-983c-26ad04878629</entry>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="uuid">5a44b25c-2877-4f3b-983c-26ad04878629</entry>
Nov 15 21:34:07 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:34:07 user nova-compute[75409]:     </system>
Nov 15 21:34:07 user nova-compute[75409]:   </sysinfo>
Nov 15 21:34:07 user nova-compute[75409]:   <os>
Nov 15 21:34:07 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:34:07 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:34:07 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:34:07 user nova-compute[75409]:   </os>
Nov 15 21:34:07 user nova-compute[75409]:   <features>
Nov 15 21:34:07 user nova-compute[75409]:     <acpi/>
Nov 15 21:34:07 user nova-compute[75409]:     <apic/>
Nov 15 21:34:07 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:34:07 user nova-compute[75409]:   </features>
Nov 15 21:34:07 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:34:07 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:34:07 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:34:07 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:34:07 user nova-compute[75409]:   </clock>
Nov 15 21:34:07 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:34:07 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:34:07 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:34:07 user nova-compute[75409]:   </cpu>
Nov 15 21:34:07 user nova-compute[75409]:   <devices>
Nov 15 21:34:07 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:34:07 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:34:07 user nova-compute[75409]:       <source dev="/dev/sdd"/>
Nov 15 21:34:07 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:34:07 user nova-compute[75409]:       <serial>d86232bb-cd44-4189-a28d-bca6674a42fe</serial>
Nov 15 21:34:07 user nova-compute[75409]:     </disk>
Nov 15 21:34:07 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:34:07 user nova-compute[75409]:       <mac address="fa:16:3e:29:d4:2a"/>
Nov 15 21:34:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:34:07 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:34:07 user nova-compute[75409]:       <target dev="tapf86cfde7-ab"/>
Nov 15 21:34:07 user nova-compute[75409]:     </interface>
Nov 15 21:34:07 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:34:07 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/5a44b25c-2877-4f3b-983c-26ad04878629/console.log" append="off"/>
Nov 15 21:34:07 user nova-compute[75409]:     </serial>
Nov 15 21:34:07 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:34:07 user nova-compute[75409]:     <video>
Nov 15 21:34:07 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:34:07 user nova-compute[75409]:     </video>
Nov 15 21:34:07 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:34:07 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:34:07 user nova-compute[75409]:     </rng>
Nov 15 21:34:07 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:34:07 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:34:07 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:34:07 user nova-compute[75409]:     </memballoon>
Nov 15 21:34:07 user nova-compute[75409]:   </devices>
Nov 15 21:34:07 user nova-compute[75409]: </domain>
Nov 15 21:34:07 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633188246',display_name='tempest-TestVolumeBootPattern-server-633188246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633188246',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0uguwpof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:54Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=5a44b25c-2877-4f3b-983c-26ad04878629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG os_vif [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d6d0cb1-1481-5222-8ee3-f742510eccfa', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf86cfde7-ab, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf86cfde7-ab, col_values=(('qos', UUID('aa75f51b-7253-419e-9381-fba3c2420383')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf86cfde7-ab, col_values=(('external_ids', {'iface-id': 'f86cfde7-ab44-42eb-9026-5708668d09a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:d4:2a', 'vm-uuid': '5a44b25c-2877-4f3b-983c-26ad04878629'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:07 user nova-compute[75409]: INFO os_vif [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab')
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:34:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:29:d4:2a, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] No waiting events found dispatching network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:08 user nova-compute[75409]: WARNING nova.compute.manager [req-49ac2dd4-b331-4cd9-9511-e4f1b6561fa9 req-11cff2a7-1e5e-41fb-bb74-33a180ef9324 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received unexpected event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 for instance with vm_state building and task_state spawning.
Nov 15 21:34:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:34:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Instance spawned successfully.
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:34:10 user nova-compute[75409]: INFO nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] No waiting events found dispatching network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:10 user nova-compute[75409]: WARNING nova.compute.manager [req-b5ff2184-0703-40b2-b429-aa910c00d062 req-bc220210-3d5e-496a-8cb1-604a0594012a service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received unexpected event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 for instance with vm_state building and task_state spawning.
Nov 15 21:34:10 user nova-compute[75409]: INFO nova.compute.manager [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Took 17.08 seconds to build instance.
Nov 15 21:34:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a89b3fdb-04a5-40c8-81c1-7d54e8ced118 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.176s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:38 user nova-compute[75409]: INFO nova.compute.manager [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Terminating instance
Nov 15 21:34:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-unplugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] No waiting events found dispatching network-vif-unplugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-b35b451d-b5ce-48f9-8210-c53b8250d8cb req-2485ea81-8a85-4166-995f-4eb579fef045 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-unplugged-34b9f659-4301-4626-bbae-9676e903c33b for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Instance destroyed successfully.
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'resources' on Instance uuid d3016724-0848-47b3-905e-c4f1700b14a3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:32:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1353367570',display_name='tempest-VolumesAdminNegativeTest-server-1353367570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1353367570',id=23,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-3ooe36gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:32:52Z,user_data=None,user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=d3016724-0848-47b3-905e-c4f1700b14a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "34b9f659-4301-4626-bbae-9676e903c33b", "address": "fa:16:3e:44:27:ee", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b9f659-43", "ovs_interfaceid": "34b9f659-4301-4626-bbae-9676e903c33b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG os_vif [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34b9f659-43, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b08ca22-28b5-4ac9-a2e9-d6e068d2be67) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:39 user nova-compute[75409]: INFO os_vif [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=34b9f659-4301-4626-bbae-9676e903c33b,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b9f659-43')
Nov 15 21:34:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Deleting instance files /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3_del
Nov 15 21:34:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Deletion of /opt/stack/data/nova/instances/d3016724-0848-47b3-905e-c4f1700b14a3_del complete
Nov 15 21:34:39 user nova-compute[75409]: INFO nova.compute.manager [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 21:34:39 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:34:39 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:40 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Took 0.52 seconds to deallocate network for instance.
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-13e49413-8fdd-4a8f-a0d5-b2dd56a47ae9 req-6d776cb4-a95a-433e-87e1-8323f4fc40df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-deleted-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:40 user nova-compute[75409]: INFO nova.compute.manager [req-13e49413-8fdd-4a8f-a0d5-b2dd56a47ae9 req-6d776cb4-a95a-433e-87e1-8323f4fc40df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Neutron deleted interface 34b9f659-4301-4626-bbae-9676e903c33b; detaching it from the instance and deleting it from the info cache
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.network.neutron [req-13e49413-8fdd-4a8f-a0d5-b2dd56a47ae9 req-6d776cb4-a95a-433e-87e1-8323f4fc40df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-13e49413-8fdd-4a8f-a0d5-b2dd56a47ae9 req-6d776cb4-a95a-433e-87e1-8323f4fc40df service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Detach interface failed, port_id=34b9f659-4301-4626-bbae-9676e903c33b, reason: Instance d3016724-0848-47b3-905e-c4f1700b14a3 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:34:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:40 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Deleted allocations for instance d3016724-0848-47b3-905e-c4f1700b14a3
Nov 15 21:34:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f2e3dcfd-1eb2-42da-93f9-9069890444ad tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "d3016724-0848-47b3-905e-c4f1700b14a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.880s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] Acquiring lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] Lock "d3016724-0848-47b3-905e-c4f1700b14a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] No waiting events found dispatching network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:41 user nova-compute[75409]: WARNING nova.compute.manager [req-f426419e-2199-47a3-96dc-8e67e6617fbb req-b5b22452-d1f8-40ef-b7cf-86ce517c8fe5 service nova] [instance: d3016724-0848-47b3-905e-c4f1700b14a3] Received unexpected event network-vif-plugged-34b9f659-4301-4626-bbae-9676e903c33b for instance with vm_state deleted and task_state None.
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [{"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.108272552490234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Applying migration context for instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 as it has an incoming, in-progress migration 2bba62bd-6ec0-4852-952a-5322c0a54469. Migration status is finished {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 21:34:48 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating resource usage from migration 2bba62bd-6ec0-4852-952a-5322c0a54469
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dd6c324b-f505-4391-813d-1534b5ed11ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Migration 2bba62bd-6ec0-4852-952a-5322c0a54469 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 5a44b25c-2877-4f3b-983c-26ad04878629 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:34:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:34:54 user nova-compute[75409]: INFO nova.compute.manager [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Rescuing
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:54 user nova-compute[75409]: WARNING nova.compute.manager [req-0707c934-346c-450e-8b30-faa70d59b91c req-ec64aab9-1389-4bdf-bb2b-8474184c2177 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state active and task_state rescuing.
Nov 15 21:34:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Port 2c9dd991-6743-45f3-af24-cd08422d3843 binding to destination host user is already ACTIVE {{(pid=75409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:34:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:34:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance destroyed successfully.
Nov 15 21:34:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Attempting rescue
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:34:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Creating image(s)
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue" returned: 0 in 0.050s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'migration_context' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.base [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<dc80da1c-5f06-44c8-bf8b-2406c22b9d73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start _get_guest_xml network_info=[{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:92:6a:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.base [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<dc80da1c-5f06-44c8-bf8b-2406c22b9d73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'numa_topology' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.base [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<dc80da1c-5f06-44c8-bf8b-2406c22b9d73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:55 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:55 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.base [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<dc80da1c-5f06-44c8-bf8b-2406c22b9d73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1141366530',display_name='tempest-ServerRescueNegativeTestJSON-server-1141366530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1141366530',id=25,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-x7wx0rvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:12Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=dc80da1c-5f06-44c8-bf8b-2406c22b9d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:92:6a:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:92:6a:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Creating tmpfile /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/tmpbnu3mm_g to verify with other compute node that the instance is on the same shared storage. {{(pid=75409) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.objects.base [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<dc80da1c-5f06-44c8-bf8b-2406c22b9d73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:34:55 user nova-compute[75409]:   <uuid>dc80da1c-5f06-44c8-bf8b-2406c22b9d73</uuid>
Nov 15 21:34:55 user nova-compute[75409]:   <name>instance-00000019</name>
Nov 15 21:34:55 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:34:55 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:34:55 user nova-compute[75409]:   <metadata>
Nov 15 21:34:55 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:34:55 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1141366530</nova:name>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:34:55</nova:creationTime>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:34:55 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:34:55 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:owner>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:34:55 user nova-compute[75409]:       </nova:owner>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:34:55 user nova-compute[75409]:       <nova:ports>
Nov 15 21:34:55 user nova-compute[75409]:         <nova:port uuid="896cbe20-15ce-4be9-9b16-c08d3d92a70b">
Nov 15 21:34:55 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 21:34:55 user nova-compute[75409]:         </nova:port>
Nov 15 21:34:55 user nova-compute[75409]:       </nova:ports>
Nov 15 21:34:55 user nova-compute[75409]:     </nova:instance>
Nov 15 21:34:55 user nova-compute[75409]:   </metadata>
Nov 15 21:34:55 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:34:55 user nova-compute[75409]:     <system>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="serial">dc80da1c-5f06-44c8-bf8b-2406c22b9d73</entry>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="uuid">dc80da1c-5f06-44c8-bf8b-2406c22b9d73</entry>
Nov 15 21:34:55 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:34:55 user nova-compute[75409]:     </system>
Nov 15 21:34:55 user nova-compute[75409]:   </sysinfo>
Nov 15 21:34:55 user nova-compute[75409]:   <os>
Nov 15 21:34:55 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:34:55 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:34:55 user nova-compute[75409]:   </os>
Nov 15 21:34:55 user nova-compute[75409]:   <features>
Nov 15 21:34:55 user nova-compute[75409]:     <acpi/>
Nov 15 21:34:55 user nova-compute[75409]:     <apic/>
Nov 15 21:34:55 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:34:55 user nova-compute[75409]:   </features>
Nov 15 21:34:55 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:34:55 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:34:55 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:34:55 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:34:55 user nova-compute[75409]:   </clock>
Nov 15 21:34:55 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:34:55 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:34:55 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:34:55 user nova-compute[75409]:   </cpu>
Nov 15 21:34:55 user nova-compute[75409]:   <devices>
Nov 15 21:34:55 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:34:55 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:34:55 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue"/>
Nov 15 21:34:55 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:34:55 user nova-compute[75409]:     </disk>
Nov 15 21:34:55 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:34:55 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:34:55 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk"/>
Nov 15 21:34:55 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:34:55 user nova-compute[75409]:     </disk>
Nov 15 21:34:55 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:34:55 user nova-compute[75409]:       <mac address="fa:16:3e:92:6a:62"/>
Nov 15 21:34:55 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:34:55 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:34:55 user nova-compute[75409]:       <target dev="tap896cbe20-15"/>
Nov 15 21:34:55 user nova-compute[75409]:     </interface>
Nov 15 21:34:55 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:34:55 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/console.log" append="off"/>
Nov 15 21:34:55 user nova-compute[75409]:     </serial>
Nov 15 21:34:55 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:34:55 user nova-compute[75409]:     <video>
Nov 15 21:34:55 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:34:55 user nova-compute[75409]:     </video>
Nov 15 21:34:55 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:34:55 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:34:55 user nova-compute[75409]:     </rng>
Nov 15 21:34:55 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:34:55 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:34:55 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:34:55 user nova-compute[75409]:     </memballoon>
Nov 15 21:34:55 user nova-compute[75409]:   </devices>
Nov 15 21:34:55 user nova-compute[75409]: </domain>
Nov 15 21:34:55 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:34:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance destroyed successfully.
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:92:6a:62, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance destroyed successfully.
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'resources' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:33:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c9dd991-67, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.015s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:56 user nova-compute[75409]: WARNING nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state active and task_state rescuing.
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:56 user nova-compute[75409]: WARNING nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state resized and task_state resize_reverting.
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:56 user nova-compute[75409]: WARNING nova.compute.manager [req-b731bc15-9d78-456a-9aeb-1ddf191e70e2 req-cb97c49c-c1ae-464a-80e0-338af456044e service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state resized and task_state resize_reverting.
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a61d56a-4f70-4353-a7f7-f9c27200e9b1) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:56 user nova-compute[75409]: INFO os_vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:34:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:34:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124fc56-f3e4-4d97-8469-2ce1f5ad4b5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:34:56 user nova-compute[75409]: No targets found.
Nov 15 21:34:56 user nova-compute[75409]: iSNS:
Nov 15 21:34:56 user nova-compute[75409]: No targets found.
Nov 15 21:34:56 user nova-compute[75409]: STATIC:
Nov 15 21:34:56 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe
Nov 15 21:34:56 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:34:56 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:34:56 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:34:56 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:34:56 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:34:56 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121
Nov 15 21:34:56 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:34:56 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:34:56 user nova-compute[75409]: FIRMWARE:
Nov 15 21:34:56 user nova-compute[75409]: No targets found.
Nov 15 21:34:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:34:56 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:34:56 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c7902-c468-4ee9-8f69-84c9559bcf55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[698947a1-1db1-4629-94a9-c2d6ec56b64e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:56 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:56 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:34:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:34:56 user nova-compute[75409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:34:56 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:34:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45fa2e3-daee-47fd-84b7-1e72df42ea97]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b8790-42c4-4fe3-aa5a-c3da97d79ba4]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1ed262-dbcd-4757-bcde-813e0489d0f2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54b2c6-28c1-40d6-ad0b-68bc4c770027]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1ba84-8303-4ea0-8556-1d92f875e536]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da44a07-7122-45fd-a7e8-bb56b524de11]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:34:57 user nova-compute[75409]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:34:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b733c6-05d1-4dbe-a218-dfc4b1efe565]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== disconnect_volume: return (276ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'migration_context' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.objects.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Object Instance<ff35ef10-9b97-4082-bf02-8fa4d9db9063> lazy-loaded attributes: resources,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.350s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:58 user nova-compute[75409]: INFO nova.compute.manager [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Swapping old allocation on dict_keys(['6d992785-dcac-407e-b10c-2f8c1f949a7e']) held by migration 2bba62bd-6ec0-4852-952a-5322c0a54469 for instance
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Overwriting current allocation {'allocations': {'6d992785-dcac-407e-b10c-2f8c1f949a7e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': 'b0c5836aea124274a11f184cdb783429', 'user_id': '53d5e54d2abc4dd78b4b18e002ddbd96', 'consumer_generation': 1} on consumer ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:58 user nova-compute[75409]: WARNING nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state active and task_state rescuing.
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:34:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:34:58 user nova-compute[75409]: WARNING nova.compute.manager [req-69ce5797-d897-4492-bf62-8a1531114f1c req-82c6419c-e9af-4a8b-814c-8935cdf278e9 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state active and task_state rescuing.
Nov 15 21:34:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff59c03b-4dff-4db5-983e-7086a345b8ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3581d7b6-ed53-4791-87c4-9e5ecb3d0786]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[782c136b-39a7-44db-9561-41ce2da07cd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4db3a2-7ba1-4407-9a65-311709969c39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-892dd254-43b7-4a94-987f-86d8dfa14c01 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:34:59 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:34:59 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b766b-9b78-4f44-acfd-ccfbf628c5e5]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG os_brick.utils [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:34:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Starting finish_revert_migration {{(pid=75409) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start _get_guest_xml network_info=[{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ff35ef10-9b97-4082-bf02-8fa4d9db9063', 'attached_at': '2023-11-15T21:35:04.000000', 'detached_at': '', 'volume_id': '22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'serial': '22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '726c090e-54db-4a05-b033-4cec5d359bfd', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:35:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:04 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:04 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:04 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8200637-766e-4e00-a1b6-b84c6a358d11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:35:04 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e7cf3-6662-4d21-8912-73caca52c7cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2] added
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad238db-4668-41a2-ad49-c0993a751ef7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa12c5b-5928-4a6d-80a8-0d64c83da3ea]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvCnEHGt" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc548e98-f15e-4a45-ae5b-8b03a3e34bff]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvCnEHGt'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddbbe90-2b7e-457f-8b76-1886718179f9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8123f90-34c3-4aee-9756-a4b7cd567fec]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae45bd62-bf71-4450-abab-4b9254354e12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:35:04 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eefdd47-0892-4e4b-8fac-7a5dac53fa9c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2067166-135e-4f5a-813e-b28283a3fecb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:04 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:04 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f98b0-3744-47de-a9d9-7704274da5b1]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:35:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432306166623264', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:35:05 user nova-compute[75409]:   <uuid>ff35ef10-9b97-4082-bf02-8fa4d9db9063</uuid>
Nov 15 21:35:05 user nova-compute[75409]:   <name>instance-00000010</name>
Nov 15 21:35:05 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:35:05 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:35:05 user nova-compute[75409]:   <metadata>
Nov 15 21:35:05 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:35:05 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherB-server-405583289</nova:name>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:35:04</nova:creationTime>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:35:05 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:35:05 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:owner>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:user uuid="53d5e54d2abc4dd78b4b18e002ddbd96">tempest-ServerActionsTestOtherB-729308147-project-member</nova:user>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:project uuid="b0c5836aea124274a11f184cdb783429">tempest-ServerActionsTestOtherB-729308147</nova:project>
Nov 15 21:35:05 user nova-compute[75409]:       </nova:owner>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:35:05 user nova-compute[75409]:       <nova:ports>
Nov 15 21:35:05 user nova-compute[75409]:         <nova:port uuid="2c9dd991-6743-45f3-af24-cd08422d3843">
Nov 15 21:35:05 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:35:05 user nova-compute[75409]:         </nova:port>
Nov 15 21:35:05 user nova-compute[75409]:       </nova:ports>
Nov 15 21:35:05 user nova-compute[75409]:     </nova:instance>
Nov 15 21:35:05 user nova-compute[75409]:   </metadata>
Nov 15 21:35:05 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:35:05 user nova-compute[75409]:     <system>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="serial">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="uuid">ff35ef10-9b97-4082-bf02-8fa4d9db9063</entry>
Nov 15 21:35:05 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:35:05 user nova-compute[75409]:     </system>
Nov 15 21:35:05 user nova-compute[75409]:   </sysinfo>
Nov 15 21:35:05 user nova-compute[75409]:   <os>
Nov 15 21:35:05 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:35:05 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:35:05 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:35:05 user nova-compute[75409]:   </os>
Nov 15 21:35:05 user nova-compute[75409]:   <features>
Nov 15 21:35:05 user nova-compute[75409]:     <acpi/>
Nov 15 21:35:05 user nova-compute[75409]:     <apic/>
Nov 15 21:35:05 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:35:05 user nova-compute[75409]:   </features>
Nov 15 21:35:05 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:35:05 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:35:05 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:35:05 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:35:05 user nova-compute[75409]:   </clock>
Nov 15 21:35:05 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:35:05 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:35:05 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:35:05 user nova-compute[75409]:   </cpu>
Nov 15 21:35:05 user nova-compute[75409]:   <devices>
Nov 15 21:35:05 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:35:05 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:35:05 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk"/>
Nov 15 21:35:05 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:35:05 user nova-compute[75409]:     </disk>
Nov 15 21:35:05 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:35:05 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:05 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:35:05 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:35:05 user nova-compute[75409]:       <serial>22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2</serial>
Nov 15 21:35:05 user nova-compute[75409]:     </disk>
Nov 15 21:35:05 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:35:05 user nova-compute[75409]:       <mac address="fa:16:3e:02:ec:b2"/>
Nov 15 21:35:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:05 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:35:05 user nova-compute[75409]:       <target dev="tap2c9dd991-67"/>
Nov 15 21:35:05 user nova-compute[75409]:     </interface>
Nov 15 21:35:05 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:35:05 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/console.log" append="off"/>
Nov 15 21:35:05 user nova-compute[75409]:     </serial>
Nov 15 21:35:05 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:35:05 user nova-compute[75409]:     <video>
Nov 15 21:35:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:05 user nova-compute[75409]:     </video>
Nov 15 21:35:05 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:35:05 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:35:05 user nova-compute[75409]:     </rng>
Nov 15 21:35:05 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:35:05 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:35:05 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:35:05 user nova-compute[75409]:     </memballoon>
Nov 15 21:35:05 user nova-compute[75409]:   </devices>
Nov 15 21:35:05 user nova-compute[75409]: </domain>
Nov 15 21:35:05 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG os_vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3facbe5a-89ea-5d39-97a0-0a2e891fabc2', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c9dd991-67, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c9dd991-67, col_values=(('qos', UUID('18a06e61-2251-4d7b-bed4-62a203af0255')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c9dd991-67, col_values=(('external_ids', {'iface-id': '2c9dd991-6743-45f3-af24-cd08422d3843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ec:b2', 'vm-uuid': 'ff35ef10-9b97-4082-bf02-8fa4d9db9063'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:05 user nova-compute[75409]: INFO os_vif [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:07 user nova-compute[75409]: WARNING nova.compute.manager [req-179d89e7-4954-44b0-b9fc-fe9b7021a3df req-51dbdde8-3276-4904-8888-08b532b414c0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state resized and task_state resize_reverting.
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:35:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance running successfully.
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] finish_revert_migration finished successfully. {{(pid=75409) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:09 user nova-compute[75409]: INFO nova.compute.manager [None req-f0631038-35f5-4444-8541-660e7cab0e7e tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance to original state: 'active'
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:09 user nova-compute[75409]: WARNING nova.compute.manager [req-bd81853a-d101-453a-8075-054fc8d93d92 req-62b52baf-d0ed-41a7-8f21-226ee02d90b0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state resized and task_state resize_reverting.
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-changed-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing instance network info cache due to event network-changed-7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:35:09 user nova-compute[75409]: DEBUG nova.network.neutron [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing network info cache for port 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updated VIF entry in instance network info cache for port 7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c0d81e-5784-4145-ba49-023d749093ab req-a0526680-1371-401d-9caf-d3df19c48ce1 service nova] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-changed-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing instance network info cache due to event network-changed-7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] Acquiring lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] Acquired lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Refreshing network info cache for port 7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:10 user nova-compute[75409]: INFO nova.compute.manager [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Detaching volume 779e09a4-b008-496b-ab92-f85de58d6121
Nov 15 21:35:11 user nova-compute[75409]: INFO nova.virt.block_device [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Attempting to driver detach volume 779e09a4-b008-496b-ab92-f85de58d6121 from mountpoint /dev/vdb
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Attempting to detach device vdb from instance dd6c324b-f505-4391-813d-1534b5ed11ec from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:35:11 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:11 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:35:11 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:35:11 user nova-compute[75409]:   <serial>779e09a4-b008-496b-ab92-f85de58d6121</serial>
Nov 15 21:35:11 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:35:11 user nova-compute[75409]: </disk>
Nov 15 21:35:11 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:35:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully detached device vdb from instance dd6c324b-f505-4391-813d-1534b5ed11ec from the persistent domain config.
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd6c324b-f505-4391-813d-1534b5ed11ec from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:35:11 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:11 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:35:11 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:35:11 user nova-compute[75409]:   <serial>779e09a4-b008-496b-ab92-f85de58d6121</serial>
Nov 15 21:35:11 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:35:11 user nova-compute[75409]: </disk>
Nov 15 21:35:11 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updated VIF entry in instance network info cache for port 7932a890-2f96-458d-b5dd-35159892f143. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [{"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e446a31a-016a-4cf3-b05e-53422ad5895d req-fb62ab22-9662-471b-8e10-fbeb4610ec68 service nova] Releasing lock "refresh_cache-dd6c324b-f505-4391-813d-1534b5ed11ec" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:35:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:35:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-changed-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Refreshing instance network info cache due to event network-changed-3a014045-0efc-4989-a690-a3af9b14cc48. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] Acquiring lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] Acquired lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Refreshing network info cache for port 3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updated VIF entry in instance network info cache for port 3a014045-0efc-4989-a690-a3af9b14cc48. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating instance_info_cache with network_info: [{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-13f15099-0a54-4ee4-82d0-45aefe76ca75 req-03b91046-b180-475f-9586-1c745826ea33 service nova] Releasing lock "refresh_cache-ee81e967-0218-462c-adb0-fb459b0cad43" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'flavor' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:21 user nova-compute[75409]: INFO nova.compute.manager [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attaching volume 0d530565-171b-4081-9bef-78c0a53f0408 to /dev/vdb
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.utils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8ae84f-bc61-448f-b5c2-17305bbad87c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ab48d-84c4-4fda-84af-434b7847bd86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f4054-52f0-4826-9bad-15eadc26062c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f7109-4cdf-4c12-b804-8ccbb1c59b84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:35:21 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:35:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6142d-3c00-4b5f-9fa2-d2e3f5e6b9fa]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG os_brick.utils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:21 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating existing volume attachment record: c170725a-378f-4e9c-99b0-649d1fb90720 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:25 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:25 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:25 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96beb72c-e1c0-4fa3-a162-e4d91deb4620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:35:25 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6723e599-1f72-4fd8-9a2c-719936e3272c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408] added
Nov 15 21:35:25 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4f9e4-90ad-4ab9-b402-59cab2f87bff]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef794895-03ea-49e6-905c-96a3b0d2c8a1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shTYiBXz {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shTYiBXz" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac10bb-d138-4b72-a126-dfd45563c08d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shTYiBXz'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad96358-eb96-4ca6-a081-73dafeee037e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[247066ac-67d7-455a-a86a-12aafe65e9eb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75761c-41af-4899-9a28-85f5bf7cd98d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]
Nov 15 21:35:26 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3efe20-93bf-4aa5-9d33-caf05f95f5b7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dddbf8-01ab-4ac1-8f42-3c9b24e0c1fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667f042-2aff-4f8a-91d3-1592a59fc902]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:35:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26239393930313565', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239393930313565', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'flavor' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:35:27 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:27 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:35:27 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:35:27 user nova-compute[75409]:   <serial>0d530565-171b-4081-9bef-78c0a53f0408</serial>
Nov 15 21:35:27 user nova-compute[75409]: </disk>
Nov 15 21:35:27 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:ee:c8:e8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:35:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a7a6337-f7dc-4dfe-bbd6-80d0c86cbbf4 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.774s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:29 user nova-compute[75409]: INFO nova.compute.manager [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Rebuilding instance
Nov 15 21:35:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:29 user nova-compute[75409]: WARNING nova.compute.manager [req-ac9700ba-a09c-4cc9-ba6b-23b461576763 req-f9d2c87f-9e6f-4bc0-99f3-0db4ebaff5bf service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state active and task_state rebuilding.
Nov 15 21:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance destroyed successfully.
Nov 15 21:35:30 user nova-compute[75409]: INFO nova.compute.manager [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Detaching volume 0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:35:30 user nova-compute[75409]: INFO nova.virt.block_device [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attempting to driver detach volume 0d530565-171b-4081-9bef-78c0a53f0408 from mountpoint /dev/vdb
Nov 15 21:35:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Attempting to detach device vdb from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:35:30 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:30 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:35:30 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:35:30 user nova-compute[75409]:   <serial>0d530565-171b-4081-9bef-78c0a53f0408</serial>
Nov 15 21:35:30 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:35:30 user nova-compute[75409]: </disk>
Nov 15 21:35:30 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:35:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully detached device vdb from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the persistent domain config.
Nov 15 21:35:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:30 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8d8ea-de12-40fd-997e-e428cec840f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:35:30 user nova-compute[75409]: No targets found.
Nov 15 21:35:30 user nova-compute[75409]: iSNS:
Nov 15 21:35:30 user nova-compute[75409]: No targets found.
Nov 15 21:35:30 user nova-compute[75409]: STATIC:
Nov 15 21:35:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe
Nov 15 21:35:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:35:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:35:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:30 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121
Nov 15 21:35:30 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:30 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:30 user nova-compute[75409]: FIRMWARE:
Nov 15 21:35:30 user nova-compute[75409]: No targets found.
Nov 15 21:35:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:35:30 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:35:30 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ce549a-938d-492d-8b02-623a74d6379d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2dbda2-992a-4e7c-8998-153421f48586]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28555c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32ced7-1bb9-41f3-91f7-03e2b392d299]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f548fc-047b-4d45-aed4-b78c41d755e8]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb49ac-87f9-4d99-b9cd-0cff7eedb4ae]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b255ffd-ccb8-4849-a435-24c0e3484a0a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e438e1a7-5f56-4bef-af5a-b7f0932ced9f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5219d68-6955-4c7b-afd6-be81595774a2]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]
Nov 15 21:35:30 user nova-compute[75409]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:30 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aebcbf3-0952-4131-86fb-a99ee005b3fa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== disconnect_volume: return (321ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:35:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:31 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd6c324b-f505-4391-813d-1534b5ed11ec is timed out.
Nov 15 21:35:31 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully detached device vdb from instance dd6c324b-f505-4391-813d-1534b5ed11ec from the live domain config.
Nov 15 21:35:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlWcZzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:31 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c4344-f74b-43d1-8403-893a8bb13717]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:35:31 user nova-compute[75409]: No targets found.
Nov 15 21:35:31 user nova-compute[75409]: iSNS:
Nov 15 21:35:31 user nova-compute[75409]: No targets found.
Nov 15 21:35:31 user nova-compute[75409]: STATIC:
Nov 15 21:35:31 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe
Nov 15 21:35:31 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:31 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:31 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:35:31 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:31 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:31 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121
Nov 15 21:35:31 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:31 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:31 user nova-compute[75409]: FIRMWARE:
Nov 15 21:35:31 user nova-compute[75409]: No targets found.
Nov 15 21:35:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:35:31 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:35:31 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae75c5b-49ea-4df7-9f5e-99299d613107]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a576a47-892e-4187-9c24-72b62791628f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:31 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:31 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 (non-flash)
Nov 15 21:35:31 user nova-compute[75409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:31 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281bac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dccba6-1c27-417b-8af3-62029e2d3cf1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53dc1c8-b4a8-467a-be95-a99fbda41cf2]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[65087d7d-3d9f-4b8b-98f5-343b1466e778]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129e249-130c-44a2-9cd3-ea9380acfd3c]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:31 user nova-compute[75409]: WARNING nova.compute.manager [req-9081dd45-f5c9-4640-a8af-69b7dde918ba req-135e0e73-ce0f-46c1-b4a2-2e4f49de57b3 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state active and task_state rebuilding.
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1f379-903d-49a9-b39f-50756171414a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb737f2-e4d4-4bf3-aca1-984f3cb402ae]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260]
Nov 15 21:35:31 user nova-compute[75409]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:779e09a4-b008-496b-ab92-f85de58d6121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e0810f-d732-4776-84fc-938239b1939c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] <== disconnect_volume: return (277ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:32 user nova-compute[75409]: INFO nova.compute.manager [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Terminating instance
Nov 15 21:35:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-unplugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] No waiting events found dispatching network-vif-unplugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-944ab712-dd80-4449-a8f4-10088202fd56 req-fcfd21d1-ecfa-4a8f-a0db-5d9f20077058 service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-unplugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance destroyed successfully.
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-ServerActionsTestOtherA-server-877530731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a014045-0e, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f07617e8-fad3-4618-8800-f8b69e90bc27) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: INFO os_vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e')
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:33 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db5362d-45cb-40f3-9e9f-a0c8c95cbc79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:35:33 user nova-compute[75409]: No targets found.
Nov 15 21:35:33 user nova-compute[75409]: iSNS:
Nov 15 21:35:33 user nova-compute[75409]: No targets found.
Nov 15 21:35:33 user nova-compute[75409]: STATIC:
Nov 15 21:35:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe
Nov 15 21:35:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:35:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:33 user nova-compute[75409]: FIRMWARE:
Nov 15 21:35:33 user nova-compute[75409]: No targets found.
Nov 15 21:35:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:35:33 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:35:33 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd651a-31d3-4896-ad7a-07bde4c11dd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0ff2c-2e34-41d3-bd9f-14f3993a1add]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:33 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:33 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087f1a20>, {}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Disconnecting from: [] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== disconnect_volume: return (76ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Deleting instance files /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43_del
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Deletion of /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43_del complete
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Instance destroyed successfully.
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lazy-loading 'resources' on Instance uuid fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963848562',display_name='tempest-VolumesAdminNegativeTest-server-963848562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963848562',id=20,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNIiik+ZViBcF6FJecxAsc8I466sXTlq//Ev4r6+dtqR4vT6/ZNraBV6335KiayQTPvXgd7KQz3wCUnyRiLG5uQqSO5x4uxynflAUp+n6xE50xVxoGRFd3nu3s/7231mQ==',key_name='tempest-keypair-1131947064',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddec4e015c454beea9d9814218dad1c5',ramdisk_id='',reservation_id='r-wfqoua9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-399086255',owner_user_name='tempest-VolumesAdminNegativeTest-399086255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:29:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1dcb2c6a3fc42d08d6af32d01475751',uuid=fc9f1ffc-6dbc-4d16-bc0e-ca453691d378,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converting VIF {"id": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "address": "fa:16:3e:21:73:ec", "network": {"id": "80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-86841799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddec4e015c454beea9d9814218dad1c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3bdf0e2-57", "ovs_interfaceid": "d3bdf0e2-5778-4821-ab53-c74fbbd298b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_vif [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3bdf0e2-57, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84455dee-2662-4530-8f9e-bba8f93e14ca) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:33 user nova-compute[75409]: INFO os_vif [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:73:ec,bridge_name='br-int',has_traffic_filtering=True,id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2,network=Network(80d59c63-7e2f-4d6b-bfb6-4d62e8ead65e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3bdf0e2-57')
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Deleting instance files /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378_del
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Deletion of /opt/stack/data/nova/instances/fc9f1ffc-6dbc-4d16-bc0e-ca453691d378_del complete
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'flavor' on Instance uuid dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.virt.block_device [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Booting with volume 0d530565-171b-4081-9bef-78c0a53f0408 at /dev/vdb
Nov 15 21:35:33 user nova-compute[75409]: INFO nova.compute.manager [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f70b9560-162c-4d7b-88d8-ecabcd216e34 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.434s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.utils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7a4d65-6344-4be6-8218-3f49b1b98c04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174fcd8-63b5-4466-8cf0-8f1cfdcf28f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe6d94-c20f-4586-ae4f-33a0f47eadb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39e5a8-7e6b-419a-9a06-9ac3e0f69370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:35:33 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:35:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a27d12d-0c1a-4174-bfe1-ceab6b0c882f]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG os_brick.utils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:33 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating existing volume attachment record: 2724b485-874f-4b9d-b473-73b63ee07d0d {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-55bce718-ebbc-4249-82a3-87faee797d43 req-acb85fa9-a698-44cd-9d64-aab43d9b31ac service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-deleted-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:34 user nova-compute[75409]: INFO nova.compute.manager [req-55bce718-ebbc-4249-82a3-87faee797d43 req-acb85fa9-a698-44cd-9d64-aab43d9b31ac service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Neutron deleted interface d3bdf0e2-5778-4821-ab53-c74fbbd298b2; detaching it from the instance and deleting it from the info cache
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-55bce718-ebbc-4249-82a3-87faee797d43 req-acb85fa9-a698-44cd-9d64-aab43d9b31ac service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:34 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Took 0.70 seconds to deallocate network for instance.
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-55bce718-ebbc-4249-82a3-87faee797d43 req-acb85fa9-a698-44cd-9d64-aab43d9b31ac service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Detach interface failed, port_id=d3bdf0e2-5778-4821-ab53-c74fbbd298b2, reason: Instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:34 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Deleted allocations for instance fc9f1ffc-6dbc-4d16-bc0e-ca453691d378
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c90bc975-6dce-4f43-bf48-19427c891b9b tempest-VolumesAdminNegativeTest-399086255 tempest-VolumesAdminNegativeTest-399086255-project-member] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] Acquiring lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] Lock "fc9f1ffc-6dbc-4d16-bc0e-ca453691d378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] No waiting events found dispatching network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:34 user nova-compute[75409]: WARNING nova.compute.manager [req-893ad5d6-9bd0-4122-95dd-02db083f770b req-d9f999bb-3445-440d-a8fc-357f98554e3b service nova] [instance: fc9f1ffc-6dbc-4d16-bc0e-ca453691d378] Received unexpected event network-vif-plugged-d3bdf0e2-5778-4821-ab53-c74fbbd298b2 for instance with vm_state deleted and task_state None.
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:35:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Creating image(s)
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk 1073741824" returned: 0 in 0.044s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:35:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Cannot resize image /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Ensure instance console log exists: /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start _get_guest_xml network_info=[{"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee81e967-0218-462c-adb0-fb459b0cad43', 'attached_at': '', 'detached_at': '', 'volume_id': '0d530565-171b-4081-9bef-78c0a53f0408', 'serial': '0d530565-171b-4081-9bef-78c0a53f0408'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '2724b485-874f-4b9d-b473-73b63ee07d0d', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:35:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 21:35:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:39 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:39 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:39 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99228eb-7fd3-4c2e-af29-de32c870a2ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:35:39 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66964c4-5a83-4835-b5c5-025d14abda5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408] added
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62a96f-83af-4d07-99f7-c45ac81c9c3b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f94e8-897b-45e5-b5a1-f068698529c5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shTYiBXz {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shTYiBXz" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebdea8-c1df-4940-b500-a52aeee0b19c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shTYiBXz'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c195ddf-3f5f-4636-94dd-fcf3cfadcfa9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcad7f9-9169-46b7-8d03-fde3c9ede4ce]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5a39b4-9a49-4224-adf7-3efeab45f111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]
Nov 15 21:35:39 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1b115-2482-44ea-9011-6b089763fcf8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3229a2d-d41c-4f93-9a60-100d07ddee8b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[301289a4-0dbb-4540-84f5-2e657a2ee9b2]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26239393930313565', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239393930313565', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-ServerActionsTestOtherA-server-877530731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:35:40 user nova-compute[75409]:   <uuid>ee81e967-0218-462c-adb0-fb459b0cad43</uuid>
Nov 15 21:35:40 user nova-compute[75409]:   <name>instance-0000001a</name>
Nov 15 21:35:40 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:35:40 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:35:40 user nova-compute[75409]:   <metadata>
Nov 15 21:35:40 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:35:40 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherA-server-877530731</nova:name>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:35:39</nova:creationTime>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:35:40 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:35:40 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:owner>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:user uuid="4ae40e5bccb84c50a4c93963d56469f9">tempest-ServerActionsTestOtherA-1526007087-project-member</nova:user>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:project uuid="a8d130f253b745e2ac2497eebbd4cf99">tempest-ServerActionsTestOtherA-1526007087</nova:project>
Nov 15 21:35:40 user nova-compute[75409]:       </nova:owner>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:35:40 user nova-compute[75409]:       <nova:ports>
Nov 15 21:35:40 user nova-compute[75409]:         <nova:port uuid="3a014045-0efc-4989-a690-a3af9b14cc48">
Nov 15 21:35:40 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 21:35:40 user nova-compute[75409]:         </nova:port>
Nov 15 21:35:40 user nova-compute[75409]:       </nova:ports>
Nov 15 21:35:40 user nova-compute[75409]:     </nova:instance>
Nov 15 21:35:40 user nova-compute[75409]:   </metadata>
Nov 15 21:35:40 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:35:40 user nova-compute[75409]:     <system>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="serial">ee81e967-0218-462c-adb0-fb459b0cad43</entry>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="uuid">ee81e967-0218-462c-adb0-fb459b0cad43</entry>
Nov 15 21:35:40 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:35:40 user nova-compute[75409]:     </system>
Nov 15 21:35:40 user nova-compute[75409]:   </sysinfo>
Nov 15 21:35:40 user nova-compute[75409]:   <os>
Nov 15 21:35:40 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:35:40 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:35:40 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:35:40 user nova-compute[75409]:   </os>
Nov 15 21:35:40 user nova-compute[75409]:   <features>
Nov 15 21:35:40 user nova-compute[75409]:     <acpi/>
Nov 15 21:35:40 user nova-compute[75409]:     <apic/>
Nov 15 21:35:40 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:35:40 user nova-compute[75409]:   </features>
Nov 15 21:35:40 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:35:40 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:35:40 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:35:40 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:35:40 user nova-compute[75409]:   </clock>
Nov 15 21:35:40 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:35:40 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:35:40 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:35:40 user nova-compute[75409]:   </cpu>
Nov 15 21:35:40 user nova-compute[75409]:   <devices>
Nov 15 21:35:40 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:35:40 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:35:40 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk"/>
Nov 15 21:35:40 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:35:40 user nova-compute[75409]:     </disk>
Nov 15 21:35:40 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:35:40 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:35:40 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:35:40 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:35:40 user nova-compute[75409]:       <serial>0d530565-171b-4081-9bef-78c0a53f0408</serial>
Nov 15 21:35:40 user nova-compute[75409]:     </disk>
Nov 15 21:35:40 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:35:40 user nova-compute[75409]:       <mac address="fa:16:3e:ee:c8:e8"/>
Nov 15 21:35:40 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:40 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:35:40 user nova-compute[75409]:       <target dev="tap3a014045-0e"/>
Nov 15 21:35:40 user nova-compute[75409]:     </interface>
Nov 15 21:35:40 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:35:40 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/console.log" append="off"/>
Nov 15 21:35:40 user nova-compute[75409]:     </serial>
Nov 15 21:35:40 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:35:40 user nova-compute[75409]:     <video>
Nov 15 21:35:40 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:40 user nova-compute[75409]:     </video>
Nov 15 21:35:40 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:35:40 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:35:40 user nova-compute[75409]:     </rng>
Nov 15 21:35:40 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:35:40 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:35:40 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:35:40 user nova-compute[75409]:     </memballoon>
Nov 15 21:35:40 user nova-compute[75409]:   </devices>
Nov 15 21:35:40 user nova-compute[75409]: </domain>
Nov 15 21:35:40 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-ServerActionsTestOtherA-server-877530731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG os_vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db20e401-473d-5b4c-8201-3fec9a45d8f3', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a014045-0e, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a014045-0e, col_values=(('qos', UUID('189f5f10-7ade-4746-b55f-2f36dd5a3f28')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a014045-0e, col_values=(('external_ids', {'iface-id': '3a014045-0efc-4989-a690-a3af9b14cc48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:c8:e8', 'vm-uuid': 'ee81e967-0218-462c-adb0-fb459b0cad43'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:40 user nova-compute[75409]: INFO os_vif [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e')
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:35:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:ee:c8:e8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:35:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:42 user nova-compute[75409]: WARNING nova.compute.manager [req-9b6e1570-f582-43cf-ac29-a87fdce30132 req-2eab8508-cf48-4ed5-ab5e-7930a793219e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 21:35:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:35:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:35:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:35:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance spawned successfully.
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:44 user nova-compute[75409]: INFO nova.compute.manager [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Terminating instance
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:44 user nova-compute[75409]: WARNING nova.compute.manager [req-826c8787-1ee7-40f6-8842-78a38922b780 req-12f80226-b400-4892-b84c-7722d214dc44 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state active and task_state None.
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bbae84a5-3336-4bbf-9026-6f0de350bfff tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-unplugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] No waiting events found dispatching network-vif-unplugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-621fe0c6-fb9f-4f2f-8469-861411fc8c8a req-e408c15e-8261-4797-9d41-c0b62f6fa4eb service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-unplugged-f86cfde7-ab44-42eb-9026-5708668d09a2 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:35:44 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Instance destroyed successfully.
Nov 15 21:35:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid 5a44b25c-2877-4f3b-983c-26ad04878629 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633188246',display_name='tempest-TestVolumeBootPattern-server-633188246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633188246',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0uguwpof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:34:11Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=5a44b25c-2877-4f3b-983c-26ad04878629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "f86cfde7-ab44-42eb-9026-5708668d09a2", "address": "fa:16:3e:29:d4:2a", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86cfde7-ab", "ovs_interfaceid": "f86cfde7-ab44-42eb-9026-5708668d09a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_vif [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf86cfde7-ab, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa75f51b-7253-419e-9381-fba3c2420383) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:45 user nova-compute[75409]: INFO os_vif [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:d4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f86cfde7-ab44-42eb-9026-5708668d09a2,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf86cfde7-ab')
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfDudgMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:35:45 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290ad4e-fa17-44c1-848c-c6a9902d4f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:35:45 user nova-compute[75409]: No targets found.
Nov 15 21:35:45 user nova-compute[75409]: iSNS:
Nov 15 21:35:45 user nova-compute[75409]: No targets found.
Nov 15 21:35:45 user nova-compute[75409]: STATIC:
Nov 15 21:35:45 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe
Nov 15 21:35:45 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:45 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:45 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:35:45 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:45 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:45 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:35:45 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:35:45 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:35:45 user nova-compute[75409]: FIRMWARE:
Nov 15 21:35:45 user nova-compute[75409]: No targets found.
Nov 15 21:35:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:35:45 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:35:45 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[352da375-f184-4f34-aeb5-c884a25fc55a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb66c7-1d1f-43d7-973f-af7202502582]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:45 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:45 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe (non-flash)
Nov 15 21:35:45 user nova-compute[75409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:35:45 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:35:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087f1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe85b44-a9cf-4517-b5be-e0b7ab5b9d31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1651dbb1-7418-4857-9fc5-02ecc6aab454]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89d741-433e-4b29-bf60-9ac3c7223c71]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[95805e86-22f1-4fad-910f-8ae4408d3565]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e16a68-e87c-4ef9-997d-d71ebe1b3f8a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdd22b-809a-481c-9d4b-c3c0a8c30060]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260]
Nov 15 21:35:45 user nova-compute[75409]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe, portal: 172.16.0.220,3260] successful.
Nov 15 21:35:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86232bb-cd44-4189-a28d-bca6674a42fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4461d-a4c7-4c66-97dd-bb626a09c2d7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (367ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:35:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Deleting instance files /opt/stack/data/nova/instances/5a44b25c-2877-4f3b-983c-26ad04878629_del
Nov 15 21:35:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Deletion of /opt/stack/data/nova/instances/5a44b25c-2877-4f3b-983c-26ad04878629_del complete
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: INFO nova.compute.manager [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:45 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:45 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Took 0.48 seconds to deallocate network for instance.
Nov 15 21:35:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] Acquiring lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] Lock "5a44b25c-2877-4f3b-983c-26ad04878629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] No waiting events found dispatching network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:46 user nova-compute[75409]: WARNING nova.compute.manager [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received unexpected event network-vif-plugged-f86cfde7-ab44-42eb-9026-5708668d09a2 for instance with vm_state active and task_state deleting.
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-1308d51f-5f15-4548-a7ce-a923373f4d47 req-beed8b7f-4103-47c2-86ba-ab35d3565291 service nova] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Received event network-vif-deleted-f86cfde7-ab44-42eb-9026-5708668d09a2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:46 user nova-compute[75409]: INFO nova.compute.manager [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Took 0.89 seconds to detach 1 volumes for instance.
Nov 15 21:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 5a44b25c-2877-4f3b-983c-26ad04878629] Deleting volume: d86232bb-cd44-4189-a28d-bca6674a42fe {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:47 user nova-compute[75409]: INFO nova.compute.manager [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Unshelving
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.763s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:47 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance 5a44b25c-2877-4f3b-983c-26ad04878629
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_requests' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'numa_topology' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:35:47 user nova-compute[75409]: INFO nova.compute.claims [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Claim successful on node user
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9032f98d-d43c-40c6-bfd7-ac1f3e0f329d tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "5a44b25c-2877-4f3b-983c-26ad04878629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.688s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=25.179988861083984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.720s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.098s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:48 user nova-compute[75409]: INFO nova.network.neutron [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating port 143fa542-7e29-448e-b41a-4c7ee6d89621 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dd6c324b-f505-4391-813d-1534b5ed11ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (6d992785-dcac-407e-b10c-2f8c1f949a7e): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing instance network info cache due to event network-changed-143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] Acquiring lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:35:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Creating image(s)
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] Acquired lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Refreshing network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77526585-a92a-411a-ad4b-ddf79ef1a3c4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "5e21906bff65c9512283050331fe4196d3a789d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "5e21906bff65c9512283050331fe4196d3a789d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG nova.virt.images [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] a03f87b5-dabf-4455-b70b-f8e240168222 was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:35:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.part /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updated VIF entry in instance network info cache for port 143fa542-7e29-448e-b41a-4c7ee6d89621. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG nova.network.neutron [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-af665f94-4473-4a13-a085-412e07eec887 req-7b5a2f4a-f79d-43f4-8d3b-b45a9030538b service nova] Releasing lock "refresh_cache-77526585-a92a-411a-ad4b-ddf79ef1a3c4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.part /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.converted" returned: 0 in 0.571s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "5e21906bff65c9512283050331fe4196d3a789d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.042s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "5e21906bff65c9512283050331fe4196d3a789d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "5e21906bff65c9512283050331fe4196d3a789d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3,backing_fmt=raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3,backing_fmt=raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk 1073741824" returned: 0 in 0.048s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "5e21906bff65c9512283050331fe4196d3a789d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'migration_context' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77526585-a92a-411a-ad4b-ddf79ef1a3c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:35:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Rebasing disk image.
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 -F raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 -F raw /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk" returned: 0 in 2.034s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start _get_guest_xml network_info=[{"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3f4c5a06a99eb9bc92a56b57b74f8769',container_format='bare',created_at=2023-11-15T21:33:54Z,direct_url=<?>,disk_format='qcow2',id=a03f87b5-dabf-4455-b70b-f8e240168222,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1416183420-shelved',owner='46dfeeef89eb4141be700d34d6d0f1ea',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T21:33:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:35:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3f4c5a06a99eb9bc92a56b57b74f8769',container_format='bare',created_at=2023-11-15T21:33:54Z,direct_url=<?>,disk_format='qcow2',id=a03f87b5-dabf-4455-b70b-f8e240168222,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1416183420-shelved',owner='46dfeeef89eb4141be700d34d6d0f1ea',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T21:33:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.objects.base [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77526585-a92a-411a-ad4b-ddf79ef1a3c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='a03f87b5-dabf-4455-b70b-f8e240168222',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-867532891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:33:58.977134',shelved_host='user',shelved_image_id='a03f87b5-dabf-4455-b70b-f8e240168222'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'pci_devices' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.objects.base [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Object Instance<77526585-a92a-411a-ad4b-ddf79ef1a3c4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:35:54 user nova-compute[75409]:   <uuid>77526585-a92a-411a-ad4b-ddf79ef1a3c4</uuid>
Nov 15 21:35:54 user nova-compute[75409]:   <name>instance-00000016</name>
Nov 15 21:35:54 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:35:54 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:35:54 user nova-compute[75409]:   <metadata>
Nov 15 21:35:54 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:35:54 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1416183420</nova:name>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:35:54</nova:creationTime>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:35:54 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:35:54 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:owner>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:user uuid="ceded6a59a6842e792ad3aced2b85da9">tempest-AttachVolumeShelveTestJSON-1237497947-project-member</nova:user>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:project uuid="46dfeeef89eb4141be700d34d6d0f1ea">tempest-AttachVolumeShelveTestJSON-1237497947</nova:project>
Nov 15 21:35:54 user nova-compute[75409]:       </nova:owner>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:root type="image" uuid="a03f87b5-dabf-4455-b70b-f8e240168222"/>
Nov 15 21:35:54 user nova-compute[75409]:       <nova:ports>
Nov 15 21:35:54 user nova-compute[75409]:         <nova:port uuid="143fa542-7e29-448e-b41a-4c7ee6d89621">
Nov 15 21:35:54 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:35:54 user nova-compute[75409]:         </nova:port>
Nov 15 21:35:54 user nova-compute[75409]:       </nova:ports>
Nov 15 21:35:54 user nova-compute[75409]:     </nova:instance>
Nov 15 21:35:54 user nova-compute[75409]:   </metadata>
Nov 15 21:35:54 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:35:54 user nova-compute[75409]:     <system>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="serial">77526585-a92a-411a-ad4b-ddf79ef1a3c4</entry>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="uuid">77526585-a92a-411a-ad4b-ddf79ef1a3c4</entry>
Nov 15 21:35:54 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:35:54 user nova-compute[75409]:     </system>
Nov 15 21:35:54 user nova-compute[75409]:   </sysinfo>
Nov 15 21:35:54 user nova-compute[75409]:   <os>
Nov 15 21:35:54 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:35:54 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:35:54 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:35:54 user nova-compute[75409]:   </os>
Nov 15 21:35:54 user nova-compute[75409]:   <features>
Nov 15 21:35:54 user nova-compute[75409]:     <acpi/>
Nov 15 21:35:54 user nova-compute[75409]:     <apic/>
Nov 15 21:35:54 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:35:54 user nova-compute[75409]:   </features>
Nov 15 21:35:54 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:35:54 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:35:54 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:35:54 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:35:54 user nova-compute[75409]:   </clock>
Nov 15 21:35:54 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:35:54 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:35:54 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:35:54 user nova-compute[75409]:   </cpu>
Nov 15 21:35:54 user nova-compute[75409]:   <devices>
Nov 15 21:35:54 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:35:54 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:35:54 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk"/>
Nov 15 21:35:54 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:35:54 user nova-compute[75409]:     </disk>
Nov 15 21:35:54 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:35:54 user nova-compute[75409]:       <mac address="fa:16:3e:9c:1e:f7"/>
Nov 15 21:35:54 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:54 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:35:54 user nova-compute[75409]:       <target dev="tap143fa542-7e"/>
Nov 15 21:35:54 user nova-compute[75409]:     </interface>
Nov 15 21:35:54 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:35:54 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/console.log" append="off"/>
Nov 15 21:35:54 user nova-compute[75409]:     </serial>
Nov 15 21:35:54 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:35:54 user nova-compute[75409]:     <video>
Nov 15 21:35:54 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:35:54 user nova-compute[75409]:     </video>
Nov 15 21:35:54 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:35:54 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:35:54 user nova-compute[75409]:     </rng>
Nov 15 21:35:54 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:35:54 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:35:54 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:35:54 user nova-compute[75409]:     </memballoon>
Nov 15 21:35:54 user nova-compute[75409]:   </devices>
Nov 15 21:35:54 user nova-compute[75409]: </domain>
Nov 15 21:35:54 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='a03f87b5-dabf-4455-b70b-f8e240168222',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-867532891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member',shelved_at='2023-11-15T21:33:58.977134',shelved_host='user',shelved_image_id='a03f87b5-dabf-4455-b70b-f8e240168222'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG os_vif [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99c00519-ef04-5002-a3ea-a89513e2940d', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap143fa542-7e, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap143fa542-7e, col_values=(('qos', UUID('3d13741d-3dca-4ce5-bff7-507ea887d3e9')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap143fa542-7e, col_values=(('external_ids', {'iface-id': '143fa542-7e29-448e-b41a-4c7ee6d89621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:1e:f7', 'vm-uuid': '77526585-a92a-411a-ad4b-ddf79ef1a3c4'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:54 user nova-compute[75409]: INFO os_vif [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e')
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:35:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] No VIF found with MAC fa:16:3e:9c:1e:f7, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:35:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:56 user nova-compute[75409]: WARNING nova.compute.manager [req-ff9b4059-7437-4ea9-a6a9-f1519b3e0cba req-79ba62be-0db1-4966-bb4e-a66ad7c75bf8 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:35:58 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance spawned successfully.
Nov 15 21:35:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:35:58 user nova-compute[75409]: WARNING nova.compute.manager [req-710a7b1f-48c0-4825-b77c-2dc23fbb2aa7 req-8705262b-e106-4b9e-9284-ab075dfd69ff service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 21:35:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:35:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f729126e-2c2b-4934-b676-99893bfcf55c tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.779s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:35:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:35:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:03 user nova-compute[75409]: INFO nova.compute.manager [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Terminating instance
Nov 15 21:36:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-de808d38-20d5-4195-afd2-8b1037802b3d req-1fd64568-fac2-42bb-bc46-191b6612cca4 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-unplugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:36:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Instance destroyed successfully.
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lazy-loading 'resources' on Instance uuid dd6c324b-f505-4391-813d-1534b5ed11ec {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-835053123',display_name='tempest-TestMinimumBasicScenario-server-835053123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-835053123',id=21,image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8TftujJxjBKxpzp2DVN3z6XO3dC/8H6HydHNNYLdsQlDXsiY+zdRKu4Enz/C2gJrwfapnr+ORMNOu1IAnjqGErYS5RYIIH9qOxZ7FtiHIt4EAV9DtJq1QjnS66mTABw==',key_name='tempest-TestMinimumBasicScenario-949963114',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:31:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7535d0ebae4485c9252ad6909720f5f',ramdisk_id='',reservation_id='r-wq0hhobb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ced994b9-9b06-40e3-a7c6-457d24240eb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-998083421',owner_user_name='tempest-TestMinimumBasicScenario-998083421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:33:26Z,user_data=None,user_id='2612ed7971eb4b28966e02093c1eceeb',uuid=dd6c324b-f505-4391-813d-1534b5ed11ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converting VIF {"id": "7932a890-2f96-458d-b5dd-35159892f143", "address": "fa:16:3e:a8:66:00", "network": {"id": "f85fd849-7839-4b34-81f8-a7c1886b39d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1413051525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7535d0ebae4485c9252ad6909720f5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7932a890-2f", "ovs_interfaceid": "7932a890-2f96-458d-b5dd-35159892f143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG os_vif [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7932a890-2f, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6e4011f-78e7-4b47-b72a-c4c3280a7c87) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: INFO os_vif [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:66:00,bridge_name='br-int',has_traffic_filtering=True,id=7932a890-2f96-458d-b5dd-35159892f143,network=Network(f85fd849-7839-4b34-81f8-a7c1886b39d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7932a890-2f')
Nov 15 21:36:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Deleting instance files /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec_del
Nov 15 21:36:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Deletion of /opt/stack/data/nova/instances/dd6c324b-f505-4391-813d-1534b5ed11ec_del complete
Nov 15 21:36:04 user nova-compute[75409]: INFO nova.compute.manager [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 21:36:04 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:36:04 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:04 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Took 0.48 seconds to deallocate network for instance.
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:05 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Deleted allocations for instance dd6c324b-f505-4391-813d-1534b5ed11ec
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5ad34160-4ce8-4c69-8398-27136eb568a9 tempest-TestMinimumBasicScenario-998083421 tempest-TestMinimumBasicScenario-998083421-project-member] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.869s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] Acquiring lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] Lock "dd6c324b-f505-4391-813d-1534b5ed11ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] No waiting events found dispatching network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:05 user nova-compute[75409]: WARNING nova.compute.manager [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received unexpected event network-vif-plugged-7932a890-2f96-458d-b5dd-35159892f143 for instance with vm_state deleted and task_state None.
Nov 15 21:36:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-607fdf20-baa6-49f3-9a1a-54b65bf1bd56 req-f6a76933-14a5-4e23-8768-eb3569f6f173 service nova] [instance: dd6c324b-f505-4391-813d-1534b5ed11ec] Received event network-vif-deleted-7932a890-2f96-458d-b5dd-35159892f143 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:36:39 user nova-compute[75409]: INFO nova.compute.claims [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Claim successful on node user
Nov 15 21:36:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:36:40 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.policy [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752b5dc398bb45608817b61c4ccbfb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d9e1e2556e4ec396ccabb7f7126bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:36:40 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Creating image(s)
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk 1073741824" returned: 0 in 0.056s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Successfully created port: 5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.204s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:36:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Cannot resize image /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Ensure instance console log exists: /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Successfully updated port: 5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquired lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-changed-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Refreshing instance network info cache due to event network-changed-5e4f6a53-1bce-4dfc-abab-dde886553ad8. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] Acquiring lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Releasing lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Instance network_info: |[{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] Acquired lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.neutron [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Refreshing network info cache for port 5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Start _get_guest_xml network_info=[{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:36:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340960267',display_name='tempest-AttachVolumeNegativeTest-server-1340960267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1340960267',id=28,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8D2QA/Rz5v2A4FDlvUn583RX2I39mAvJVQm7eUwIkB8QM9KEma9gllxSn2U8ah9yKJv+7KNQZft8Bei5AgAU1slt8Mro7eteF+XyWNul0qZMwRKCeV//hoPl56khWF0Q==',key_name='tempest-keypair-1865124002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-fvop1bc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=f2c3b14a-29bb-4a3f-a386-9e60aa156ed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.objects.instance [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'pci_devices' on Instance uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:36:41 user nova-compute[75409]:   <uuid>f2c3b14a-29bb-4a3f-a386-9e60aa156ed3</uuid>
Nov 15 21:36:41 user nova-compute[75409]:   <name>instance-0000001c</name>
Nov 15 21:36:41 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:36:41 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:36:41 user nova-compute[75409]:   <metadata>
Nov 15 21:36:41 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:36:41 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1340960267</nova:name>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:36:41</nova:creationTime>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:36:41 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:36:41 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:owner>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:user uuid="752b5dc398bb45608817b61c4ccbfb8b">tempest-AttachVolumeNegativeTest-1984244406-project-member</nova:user>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:project uuid="45d9e1e2556e4ec396ccabb7f7126bf0">tempest-AttachVolumeNegativeTest-1984244406</nova:project>
Nov 15 21:36:41 user nova-compute[75409]:       </nova:owner>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:36:41 user nova-compute[75409]:       <nova:ports>
Nov 15 21:36:41 user nova-compute[75409]:         <nova:port uuid="5e4f6a53-1bce-4dfc-abab-dde886553ad8">
Nov 15 21:36:41 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:36:41 user nova-compute[75409]:         </nova:port>
Nov 15 21:36:41 user nova-compute[75409]:       </nova:ports>
Nov 15 21:36:41 user nova-compute[75409]:     </nova:instance>
Nov 15 21:36:41 user nova-compute[75409]:   </metadata>
Nov 15 21:36:41 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:36:41 user nova-compute[75409]:     <system>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="serial">f2c3b14a-29bb-4a3f-a386-9e60aa156ed3</entry>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="uuid">f2c3b14a-29bb-4a3f-a386-9e60aa156ed3</entry>
Nov 15 21:36:41 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:36:41 user nova-compute[75409]:     </system>
Nov 15 21:36:41 user nova-compute[75409]:   </sysinfo>
Nov 15 21:36:41 user nova-compute[75409]:   <os>
Nov 15 21:36:41 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:36:41 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:36:41 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:36:41 user nova-compute[75409]:   </os>
Nov 15 21:36:41 user nova-compute[75409]:   <features>
Nov 15 21:36:41 user nova-compute[75409]:     <acpi/>
Nov 15 21:36:41 user nova-compute[75409]:     <apic/>
Nov 15 21:36:41 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:36:41 user nova-compute[75409]:   </features>
Nov 15 21:36:41 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:36:41 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:36:41 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:36:41 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:36:41 user nova-compute[75409]:   </clock>
Nov 15 21:36:41 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:36:41 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:36:41 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:36:41 user nova-compute[75409]:   </cpu>
Nov 15 21:36:41 user nova-compute[75409]:   <devices>
Nov 15 21:36:41 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:36:41 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:36:41 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk"/>
Nov 15 21:36:41 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:36:41 user nova-compute[75409]:     </disk>
Nov 15 21:36:41 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:36:41 user nova-compute[75409]:       <mac address="fa:16:3e:e4:a9:0d"/>
Nov 15 21:36:41 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:36:41 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:36:41 user nova-compute[75409]:       <target dev="tap5e4f6a53-1b"/>
Nov 15 21:36:41 user nova-compute[75409]:     </interface>
Nov 15 21:36:41 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:36:41 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/console.log" append="off"/>
Nov 15 21:36:41 user nova-compute[75409]:     </serial>
Nov 15 21:36:41 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:36:41 user nova-compute[75409]:     <video>
Nov 15 21:36:41 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:36:41 user nova-compute[75409]:     </video>
Nov 15 21:36:41 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:36:41 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:36:41 user nova-compute[75409]:     </rng>
Nov 15 21:36:41 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:36:41 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:36:41 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:36:41 user nova-compute[75409]:     </memballoon>
Nov 15 21:36:41 user nova-compute[75409]:   </devices>
Nov 15 21:36:41 user nova-compute[75409]: </domain>
Nov 15 21:36:41 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340960267',display_name='tempest-AttachVolumeNegativeTest-server-1340960267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1340960267',id=28,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8D2QA/Rz5v2A4FDlvUn583RX2I39mAvJVQm7eUwIkB8QM9KEma9gllxSn2U8ah9yKJv+7KNQZft8Bei5AgAU1slt8Mro7eteF+XyWNul0qZMwRKCeV//hoPl56khWF0Q==',key_name='tempest-keypair-1865124002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-fvop1bc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=f2c3b14a-29bb-4a3f-a386-9e60aa156ed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG os_vif [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ec8754d-2ea9-52af-85ae-478d1365920d', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4f6a53-1b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e4f6a53-1b, col_values=(('qos', UUID('bb797f58-3e26-45de-a74a-e9d8a0bac0b3')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e4f6a53-1b, col_values=(('external_ids', {'iface-id': '5e4f6a53-1bce-4dfc-abab-dde886553ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:a9:0d', 'vm-uuid': 'f2c3b14a-29bb-4a3f-a386-9e60aa156ed3'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:36:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:41 user nova-compute[75409]: INFO os_vif [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b')
Nov 15 21:36:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:36:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:e4:a9:0d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:36:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:42 user nova-compute[75409]: DEBUG nova.network.neutron [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updated VIF entry in instance network info cache for port 5e4f6a53-1bce-4dfc-abab-dde886553ad8. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:36:42 user nova-compute[75409]: DEBUG nova.network.neutron [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7bb6c676-dc92-486f-a9e2-3498b3585074 req-ea360e35-c5d9-4443-b1ea-75336614d48f service nova] Releasing lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] No waiting events found dispatching network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:43 user nova-compute[75409]: WARNING nova.compute.manager [req-623d9506-0a65-44d7-a20b-1ee654228e07 req-ac83029d-f786-4393-803e-39d9cc670217 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received unexpected event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 for instance with vm_state building and task_state spawning.
Nov 15 21:36:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:36:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Instance spawned successfully.
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:45 user nova-compute[75409]: INFO nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:36:45 user nova-compute[75409]: INFO nova.compute.claims [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Claim successful on node user
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] No waiting events found dispatching network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:45 user nova-compute[75409]: WARNING nova.compute.manager [req-426e741f-5cba-4f00-bd1f-04b07317a526 req-a6eebcf2-ef6f-485b-b2a3-7322d4afd9ca service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received unexpected event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 for instance with vm_state building and task_state spawning.
Nov 15 21:36:45 user nova-compute[75409]: INFO nova.compute.manager [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Took 6.01 seconds to build instance.
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-927cdee1-bef9-4911-affb-aa8033673573 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.119s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:36:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Skipping network cache update for instance because it is Building. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.policy [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:36:46 user nova-compute[75409]: INFO nova.virt.block_device [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Booting with volume 67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 at /dev/vda
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.utils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3110ab-50cf-4808-9ae2-1147586b5dda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc160439-a458-46f9-a670-4a724d6d084e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ea3e1a-d382-4c4b-b79f-86f29731ff7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ab37dc-6527-4d29-8d5d-1bd6b384b7ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:36:46 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03dffd-f9b2-48c2-93b4-0ffb2f63aba5]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG os_brick.utils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updating existing volume attachment record: da2e7178-7dde-4316-8d43-f4743b5835a4 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [{"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-ff35ef10-9b97-4082-bf02-8fa4d9db9063" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Successfully created port: ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:36:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Successfully updated port: ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-changed-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Refreshing instance network info cache due to event network-changed-ca4228d2-1d97-4972-bdab-81f633463018. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] Acquiring lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updating instance_info_cache with network_info: [{"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Instance network_info: |[{"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] Acquired lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Refreshing network info cache for port ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updated VIF entry in instance network info cache for port ca4228d2-1d97-4972-bdab-81f633463018. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updating instance_info_cache with network_info: [{"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d274c151-8d56-42e4-82e8-e99fb79486e7 req-abe85645-f5b3-4e81-ab3f-af1379cb684a service nova] Releasing lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:50 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:50 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.150890350341797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 77526585-a92a-411a-ad4b-ddf79ef1a3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fad92565-0779-43a4-9c78-8985a4fb59b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:36:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:36:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Creating image(s)
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Ensure instance console log exists: /opt/stack/data/nova/instances/fad92565-0779-43a4-9c78-8985a4fb59b2/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Start _get_guest_xml network_info=[{"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCgipFIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fad92565-0779-43a4-9c78-8985a4fb59b2', 'attached_at': '', 'detached_at': '', 'volume_id': '67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 'serial': '67d5450e-ab0a-4340-82d8-fd6e1d5c93f4'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'da2e7178-7dde-4316-8d43-f4743b5835a4', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:36:51 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:51 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCgipFIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:36:51 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:36:51 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:36:51 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc768ed-d117-49fb-9d96-125f1b5961f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:36:51 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd3144-e58b-473f-84fa-d72e7e950c94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4] added
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ff0ef-062d-4982-9f08-9b18a6041323]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9593e-351a-4749-8e04-0b0b48ed2c96]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCgipFIq {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCgipFIq" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3583b-646d-473d-9da9-437af3903ac6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCgipFIq'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e843010-4050-4194-93ad-f2f0977ce168]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba20eb-3d7a-4dfd-9f46-1d6bed70b0fb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[871eda89-6da5-471c-bf35-941179787ff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260]
Nov 15 21:36:51 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260] successful.
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb1f86-c89a-4836-b0fc-d35120713212]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598c641-60f3-429d-931a-f194cdc33996]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:36:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745e5d6-f4c8-4a0f-a463-63b19a0b1060]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:36:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCgipFIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26339663931343331', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339663931343331', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1292074125',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAbSBlO+kebRXOnAVDg28AGF/3WElEZtJcVq8M763IbthW9GiR+393Z3wMNfUCgYNboXTaNotMLoKqFIr0+8XECTeSnUZSsmh+42tJNfMfBkiUmuJA0RWMHcqdyUkNhQg==',key_name='tempest-keypair-678695477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-814rct3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=fad92565-0779-43a4-9c78-8985a4fb59b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:36:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid fad92565-0779-43a4-9c78-8985a4fb59b2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:36:53 user nova-compute[75409]:   <uuid>fad92565-0779-43a4-9c78-8985a4fb59b2</uuid>
Nov 15 21:36:53 user nova-compute[75409]:   <name>instance-0000001d</name>
Nov 15 21:36:53 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:36:53 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:36:53 user nova-compute[75409]:   <metadata>
Nov 15 21:36:53 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:36:53 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:36:53 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1292074125</nova:name>
Nov 15 21:36:53 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:36:51</nova:creationTime>
Nov 15 21:36:53 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:36:53 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:36:53 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:36:53 user nova-compute[75409]:       <nova:owner>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:36:53 user nova-compute[75409]:       </nova:owner>
Nov 15 21:36:53 user nova-compute[75409]:       <nova:ports>
Nov 15 21:36:53 user nova-compute[75409]:         <nova:port uuid="ca4228d2-1d97-4972-bdab-81f633463018">
Nov 15 21:36:53 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 21:36:53 user nova-compute[75409]:         </nova:port>
Nov 15 21:36:53 user nova-compute[75409]:       </nova:ports>
Nov 15 21:36:53 user nova-compute[75409]:     </nova:instance>
Nov 15 21:36:53 user nova-compute[75409]:   </metadata>
Nov 15 21:36:53 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:36:53 user nova-compute[75409]:     <system>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="serial">fad92565-0779-43a4-9c78-8985a4fb59b2</entry>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="uuid">fad92565-0779-43a4-9c78-8985a4fb59b2</entry>
Nov 15 21:36:53 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:36:53 user nova-compute[75409]:     </system>
Nov 15 21:36:53 user nova-compute[75409]:   </sysinfo>
Nov 15 21:36:53 user nova-compute[75409]:   <os>
Nov 15 21:36:53 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:36:53 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:36:53 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:36:53 user nova-compute[75409]:   </os>
Nov 15 21:36:53 user nova-compute[75409]:   <features>
Nov 15 21:36:53 user nova-compute[75409]:     <acpi/>
Nov 15 21:36:53 user nova-compute[75409]:     <apic/>
Nov 15 21:36:53 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:36:53 user nova-compute[75409]:   </features>
Nov 15 21:36:53 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:36:53 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:36:53 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:36:53 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:36:53 user nova-compute[75409]:   </clock>
Nov 15 21:36:53 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:36:53 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:36:53 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:36:53 user nova-compute[75409]:   </cpu>
Nov 15 21:36:53 user nova-compute[75409]:   <devices>
Nov 15 21:36:53 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:36:53 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:36:53 user nova-compute[75409]:       <source dev="/dev/sdd"/>
Nov 15 21:36:53 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:36:53 user nova-compute[75409]:       <serial>67d5450e-ab0a-4340-82d8-fd6e1d5c93f4</serial>
Nov 15 21:36:53 user nova-compute[75409]:     </disk>
Nov 15 21:36:53 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:36:53 user nova-compute[75409]:       <mac address="fa:16:3e:78:7c:a1"/>
Nov 15 21:36:53 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:36:53 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:36:53 user nova-compute[75409]:       <target dev="tapca4228d2-1d"/>
Nov 15 21:36:53 user nova-compute[75409]:     </interface>
Nov 15 21:36:53 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:36:53 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/fad92565-0779-43a4-9c78-8985a4fb59b2/console.log" append="off"/>
Nov 15 21:36:53 user nova-compute[75409]:     </serial>
Nov 15 21:36:53 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:36:53 user nova-compute[75409]:     <video>
Nov 15 21:36:53 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:36:53 user nova-compute[75409]:     </video>
Nov 15 21:36:53 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:36:53 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:36:53 user nova-compute[75409]:     </rng>
Nov 15 21:36:53 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:36:53 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:36:53 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:36:53 user nova-compute[75409]:     </memballoon>
Nov 15 21:36:53 user nova-compute[75409]:   </devices>
Nov 15 21:36:53 user nova-compute[75409]: </domain>
Nov 15 21:36:53 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1292074125',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAbSBlO+kebRXOnAVDg28AGF/3WElEZtJcVq8M763IbthW9GiR+393Z3wMNfUCgYNboXTaNotMLoKqFIr0+8XECTeSnUZSsmh+42tJNfMfBkiUmuJA0RWMHcqdyUkNhQg==',key_name='tempest-keypair-678695477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-814rct3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=fad92565-0779-43a4-9c78-8985a4fb59b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG os_vif [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff643237-83ca-5779-bce5-88050a87c25a', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4228d2-1d, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca4228d2-1d, col_values=(('qos', UUID('cfab2a3a-ba4d-437b-a519-b44098f2bf65')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca4228d2-1d, col_values=(('external_ids', {'iface-id': 'ca4228d2-1d97-4972-bdab-81f633463018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:7c:a1', 'vm-uuid': 'fad92565-0779-43a4-9c78-8985a4fb59b2'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:53 user nova-compute[75409]: INFO os_vif [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d')
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:36:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:78:7c:a1, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] No waiting events found dispatching network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:54 user nova-compute[75409]: WARNING nova.compute.manager [req-3368a70d-87dc-42cd-8ff9-47e6d911fefb req-3e844ced-fe42-4b93-a0d0-5a7f31d4570d service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received unexpected event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 for instance with vm_state building and task_state spawning.
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:36:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Instance spawned successfully.
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:56 user nova-compute[75409]: INFO nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:36:56 user nova-compute[75409]: INFO nova.compute.manager [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Took 11.07 seconds to build instance.
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] No waiting events found dispatching network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:36:56 user nova-compute[75409]: WARNING nova.compute.manager [req-63a33896-b12c-4369-80fc-923876a75ee3 req-35cafc4a-5e55-4cec-b899-a27137a9ef9f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received unexpected event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 for instance with vm_state active and task_state None.
Nov 15 21:36:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-47a64bd9-9756-45fc-98fa-d7ab1b7ce2ee tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.262s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:36:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:36:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:37:17 user nova-compute[75409]: INFO nova.compute.claims [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Claim successful on node user
Nov 15 21:37:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:37:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.policy [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b68c1d5a1f42f09cfe7ba3b860d40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379b1b186a54fac907d4e4f270f1bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:37:18 user nova-compute[75409]: INFO nova.virt.block_device [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Booting with volume 8601d547-ec5f-4cbc-b7dc-0e6c41655f20 at /dev/vda
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.utils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde3b1c-f4d1-4992-8107-f3d2d4097291]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[034680a3-73cb-45ee-95eb-6ecd734e2198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c25a3-881d-45f8-9362-8a572b6f55f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c77537-e0dc-4f12-a74b-f2c3c74058f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:37:18 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:37:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf848c75-3951-4d07-baed-6699f87a9ddd]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG os_brick.utils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:37:18 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating existing volume attachment record: b7b392dc-4168-47e6-b1e2-125388ce3fb9 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Successfully created port: 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Successfully updated port: 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing instance network info cache due to event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance network_info: |[{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:37:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:37:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updated VIF entry in instance network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:37:20 user nova-compute[75409]: DEBUG nova.network.neutron [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-df7fe551-f87e-4655-9f1b-5aa84ea2596c req-fb5d0f21-d92b-4e9c-9dac-443491cf6d6c service nova] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:37:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Creating image(s)
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start _get_guest_xml network_info=[{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e76992cb-1288-4d56-b821-10232ba24eb9', 'attached_at': '', 'detached_at': '', 'volume_id': '8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'serial': '8601d547-ec5f-4cbc-b7dc-0e6c41655f20'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b7b392dc-4168-47e6-b1e2-125388ce3fb9', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:37:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:37:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:37:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:37:23 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d0644-31da-45ce-a88e-2d6b7ec12615]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:37:23 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1bee65-477e-4aed-829a-0bd858b3c2fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20] added
Nov 15 21:37:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[234c462b-b254-4ecd-a1e8-45e3bd3cb518]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87cefd-3ead-4eff-a236-0ee95f74a266]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPCnedoN {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPCnedoN" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d215aef-8e1b-4c46-b76b-e344952e4eca]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPCnedoN'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1fc699-8ec5-4d29-acc0-8e34a2f0a8af]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74412dc7-348e-46a7-adee-5a4c366cef2a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84fc3b7-bd1e-4cb7-b6f7-b637c770d124]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]
Nov 15 21:37:24 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.
Nov 15 21:37:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3274a3-bd84-4486-b278-2ad22a1f396e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6324198-7029-4df6-879e-facf74289c50]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:37:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b189517-0519-406e-8b74-08a4f747e377]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:37:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23637396664373163', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637396664373163', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT+V+solto7CW75MJneGFUQj+CHR8ovATiaLIQZ3t99se9MgA/t8ZQ6Ap6SfN9VNZkLNJHya6NApaIZF/KlS6tyWYZgqJWLSjE3+a9pe7Mwl1peyiIhqi0nm912lK5KTQ==',key_name='tempest-TestShelveInstance-1229559182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:37:18Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'pci_devices' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:37:25 user nova-compute[75409]:   <uuid>e76992cb-1288-4d56-b821-10232ba24eb9</uuid>
Nov 15 21:37:25 user nova-compute[75409]:   <name>instance-0000001e</name>
Nov 15 21:37:25 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:37:25 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:37:25 user nova-compute[75409]:   <metadata>
Nov 15 21:37:25 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:37:25 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:37:25 user nova-compute[75409]:       <nova:name>tempest-TestShelveInstance-server-2099334093</nova:name>
Nov 15 21:37:25 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:37:23</nova:creationTime>
Nov 15 21:37:25 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:37:25 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:37:25 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:37:25 user nova-compute[75409]:       <nova:owner>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:user uuid="61b68c1d5a1f42f09cfe7ba3b860d40d">tempest-TestShelveInstance-67678213-project-member</nova:user>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:project uuid="2379b1b186a54fac907d4e4f270f1bdc">tempest-TestShelveInstance-67678213</nova:project>
Nov 15 21:37:25 user nova-compute[75409]:       </nova:owner>
Nov 15 21:37:25 user nova-compute[75409]:       <nova:ports>
Nov 15 21:37:25 user nova-compute[75409]:         <nova:port uuid="78a30fb2-9596-40d3-babb-d53e874d7f95">
Nov 15 21:37:25 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:37:25 user nova-compute[75409]:         </nova:port>
Nov 15 21:37:25 user nova-compute[75409]:       </nova:ports>
Nov 15 21:37:25 user nova-compute[75409]:     </nova:instance>
Nov 15 21:37:25 user nova-compute[75409]:   </metadata>
Nov 15 21:37:25 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:37:25 user nova-compute[75409]:     <system>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="serial">e76992cb-1288-4d56-b821-10232ba24eb9</entry>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="uuid">e76992cb-1288-4d56-b821-10232ba24eb9</entry>
Nov 15 21:37:25 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:37:25 user nova-compute[75409]:     </system>
Nov 15 21:37:25 user nova-compute[75409]:   </sysinfo>
Nov 15 21:37:25 user nova-compute[75409]:   <os>
Nov 15 21:37:25 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:37:25 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:37:25 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:37:25 user nova-compute[75409]:   </os>
Nov 15 21:37:25 user nova-compute[75409]:   <features>
Nov 15 21:37:25 user nova-compute[75409]:     <acpi/>
Nov 15 21:37:25 user nova-compute[75409]:     <apic/>
Nov 15 21:37:25 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:37:25 user nova-compute[75409]:   </features>
Nov 15 21:37:25 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:37:25 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:37:25 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:37:25 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:37:25 user nova-compute[75409]:   </clock>
Nov 15 21:37:25 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:37:25 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:37:25 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:37:25 user nova-compute[75409]:   </cpu>
Nov 15 21:37:25 user nova-compute[75409]:   <devices>
Nov 15 21:37:25 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:37:25 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:37:25 user nova-compute[75409]:       <source dev="/dev/sde"/>
Nov 15 21:37:25 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:37:25 user nova-compute[75409]:       <serial>8601d547-ec5f-4cbc-b7dc-0e6c41655f20</serial>
Nov 15 21:37:25 user nova-compute[75409]:     </disk>
Nov 15 21:37:25 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:37:25 user nova-compute[75409]:       <mac address="fa:16:3e:45:1f:ae"/>
Nov 15 21:37:25 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:37:25 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:37:25 user nova-compute[75409]:       <target dev="tap78a30fb2-95"/>
Nov 15 21:37:25 user nova-compute[75409]:     </interface>
Nov 15 21:37:25 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:37:25 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9/console.log" append="off"/>
Nov 15 21:37:25 user nova-compute[75409]:     </serial>
Nov 15 21:37:25 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:37:25 user nova-compute[75409]:     <video>
Nov 15 21:37:25 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:37:25 user nova-compute[75409]:     </video>
Nov 15 21:37:25 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:37:25 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:37:25 user nova-compute[75409]:     </rng>
Nov 15 21:37:25 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:37:25 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:37:25 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:37:25 user nova-compute[75409]:     </memballoon>
Nov 15 21:37:25 user nova-compute[75409]:   </devices>
Nov 15 21:37:25 user nova-compute[75409]: </domain>
Nov 15 21:37:25 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT+V+solto7CW75MJneGFUQj+CHR8ovATiaLIQZ3t99se9MgA/t8ZQ6Ap6SfN9VNZkLNJHya6NApaIZF/KlS6tyWYZgqJWLSjE3+a9pe7Mwl1peyiIhqi0nm912lK5KTQ==',key_name='tempest-TestShelveInstance-1229559182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:37:18Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG os_vif [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9909a887-36a5-5a41-b86b-d30121b953dd', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78a30fb2-95, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78a30fb2-95, col_values=(('qos', UUID('474e71a3-aeb7-473d-9397-bef5cb1d269c')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78a30fb2-95, col_values=(('external_ids', {'iface-id': '78a30fb2-9596-40d3-babb-d53e874d7f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:1f:ae', 'vm-uuid': 'e76992cb-1288-4d56-b821-10232ba24eb9'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:25 user nova-compute[75409]: INFO os_vif [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95')
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:37:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] No VIF found with MAC fa:16:3e:45:1f:ae, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG nova.compute.manager [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:26 user nova-compute[75409]: DEBUG nova.compute.manager [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:26 user nova-compute[75409]: WARNING nova.compute.manager [req-284de243-e1a1-457d-92ce-ad300caac2e7 req-69805d07-d73a-4d25-9d94-78e46dd2c46f service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state building and task_state spawning.
Nov 15 21:37:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:37:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance spawned successfully.
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:37:28 user nova-compute[75409]: INFO nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:28 user nova-compute[75409]: WARNING nova.compute.manager [req-3e5f2dc8-67f9-4e8b-bc72-433e8b01cbdd req-3b7c9ad7-224b-48e7-ac62-1c32418a463a service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state building and task_state spawning.
Nov 15 21:37:28 user nova-compute[75409]: INFO nova.compute.manager [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Took 10.83 seconds to build instance.
Nov 15 21:37:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a27347db-e72c-4988-979f-b8757c6d692a tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.933s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:37:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:37 user nova-compute[75409]: INFO nova.compute.manager [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Terminating instance
Nov 15 21:37:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-b27d7fda-8aa5-49c2-b7e4-fe0c6d850f10 req-cd91a38f-bab6-4889-8306-139631003690 service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-unplugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Instance destroyed successfully.
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lazy-loading 'resources' on Instance uuid 77526585-a92a-411a-ad4b-ddf79ef1a3c4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:32:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1416183420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1416183420',id=22,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj9lkJ6JzRsVuY9EzWH5rwqPrEhaA7v1OPNfnzbdOycYveda2BsQWNpXeLTQvoXJfAFhKfsnDcixZPRU8xSSStrOo3gtyKqlf2Vlrw1iUYt0iSxmaULBDrmr++uYHaSkA==',key_name='tempest-keypair-867532891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46dfeeef89eb4141be700d34d6d0f1ea',ramdisk_id='',reservation_id='r-t4wo95j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1237497947',owner_user_name='tempest-AttachVolumeShelveTestJSON-1237497947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ceded6a59a6842e792ad3aced2b85da9',uuid=77526585-a92a-411a-ad4b-ddf79ef1a3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converting VIF {"id": "143fa542-7e29-448e-b41a-4c7ee6d89621", "address": "fa:16:3e:9c:1e:f7", "network": {"id": "a2d20df1-67a9-49c0-8072-7d8b7ad91637", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-877069441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46dfeeef89eb4141be700d34d6d0f1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap143fa542-7e", "ovs_interfaceid": "143fa542-7e29-448e-b41a-4c7ee6d89621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG os_vif [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap143fa542-7e, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d13741d-3dca-4ce5-bff7-507ea887d3e9) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:38 user nova-compute[75409]: INFO os_vif [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=143fa542-7e29-448e-b41a-4c7ee6d89621,network=Network(a2d20df1-67a9-49c0-8072-7d8b7ad91637),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap143fa542-7e')
Nov 15 21:37:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Deleting instance files /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4_del
Nov 15 21:37:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Deletion of /opt/stack/data/nova/instances/77526585-a92a-411a-ad4b-ddf79ef1a3c4_del complete
Nov 15 21:37:38 user nova-compute[75409]: INFO nova.compute.manager [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 21:37:38 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:37:38 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:39 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Took 0.66 seconds to deallocate network for instance.
Nov 15 21:37:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:39 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Deleted allocations for instance 77526585-a92a-411a-ad4b-ddf79ef1a3c4
Nov 15 21:37:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-db34a284-29aa-4ba1-a167-25e0a4b23438 tempest-AttachVolumeShelveTestJSON-1237497947 tempest-AttachVolumeShelveTestJSON-1237497947-project-member] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] Acquiring lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] Lock "77526585-a92a-411a-ad4b-ddf79ef1a3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] No waiting events found dispatching network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:40 user nova-compute[75409]: WARNING nova.compute.manager [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received unexpected event network-vif-plugged-143fa542-7e29-448e-b41a-4c7ee6d89621 for instance with vm_state deleted and task_state None.
Nov 15 21:37:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-2bb583f6-1e9e-42ce-9352-26014c9a9e28 req-b6481162-5ce0-43e3-a044-78b85da8e23d service nova] [instance: 77526585-a92a-411a-ad4b-ddf79ef1a3c4] Received event network-vif-deleted-143fa542-7e29-448e-b41a-4c7ee6d89621 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:37:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:45 user nova-compute[75409]: INFO nova.compute.manager [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Terminating instance
Nov 15 21:37:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-3999dccc-f1c2-400f-aa37-4c870bd0f44e req-753d570a-b541-404e-b888-8e9bb0f44df0 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-unplugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:37:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Instance destroyed successfully.
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lazy-loading 'resources' on Instance uuid ff35ef10-9b97-4082-bf02-8fa4d9db9063 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-405583289',display_name='tempest-ServerActionsTestOtherB-server-405583289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-405583289',id=16,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZBOx22ICR+1UWDQ4ka2lTK4S8+z5IF8LNvLsb0Df6EWqr1QmyJnjgwYmDCZHSo99Suun5bANrfdPIKQnBzGp17eZzxrpjH+JlFmzdG63LDOWtY6iAm6TgEBqiUapDM4A==',key_name='tempest-keypair-413965508',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:35:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0c5836aea124274a11f184cdb783429',ramdisk_id='',reservation_id='r-iucsepjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-729308147',owner_user_name='tempest-ServerActionsTestOtherB-729308147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d5e54d2abc4dd78b4b18e002ddbd96',uuid=ff35ef10-9b97-4082-bf02-8fa4d9db9063,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converting VIF {"id": "2c9dd991-6743-45f3-af24-cd08422d3843", "address": "fa:16:3e:02:ec:b2", "network": {"id": "cc9a1a8e-29f7-4e34-a3a6-1779c88c4564", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-623261240-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0c5836aea124274a11f184cdb783429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c9dd991-67", "ovs_interfaceid": "2c9dd991-6743-45f3-af24-cd08422d3843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_vif [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c9dd991-67, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18a06e61-2251-4d7b-bed4-62a203af0255) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:46 user nova-compute[75409]: INFO os_vif [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ec:b2,bridge_name='br-int',has_traffic_filtering=True,id=2c9dd991-6743-45f3-af24-cd08422d3843,network=Network(cc9a1a8e-29f7-4e34-a3a6-1779c88c4564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c9dd991-67')
Nov 15 21:37:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvCnEHGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:37:46 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f905ff-b88e-4c73-840a-da6e41e24f59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:37:46 user nova-compute[75409]: No targets found.
Nov 15 21:37:46 user nova-compute[75409]: iSNS:
Nov 15 21:37:46 user nova-compute[75409]: No targets found.
Nov 15 21:37:46 user nova-compute[75409]: STATIC:
Nov 15 21:37:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2
Nov 15 21:37:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:37:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:37:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:37:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:37:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:37:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4
Nov 15 21:37:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:37:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:37:46 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:37:46 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:37:46 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:37:46 user nova-compute[75409]: FIRMWARE:
Nov 15 21:37:46 user nova-compute[75409]: No targets found.
Nov 15 21:37:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:37:46 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:37:46 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81917a2-6982-47a5-86ec-5a7cb6be203a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebbdd7-f104-4122-acac-145958c20111]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:37:46 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281cf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3df930-517c-4da6-bf63-ebfeecda3d63]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a386dcfd-2e06-4ac2-b1f0-4cc7e54e3a8e]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cacfac-c232-42aa-a2ae-ff5ce2b78488]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7846a879-1125-474b-be88-d4c2bba3dfd7]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd95dd-06b4-418b-89ef-8e6a7cf03c77]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21832900-ece5-4512-a176-47672084215a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260]
Nov 15 21:37:47 user nova-compute[75409]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2, portal: 172.16.0.220,3260] successful.
Nov 15 21:37:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d8fd90-9e9c-46f8-8b6f-22b1a22d03a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e59380-5f1d-4ecb-bbaa-00c78ec42025]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] <== disconnect_volume: return (318ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:37:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Deleting instance files /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_del
Nov 15 21:37:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Deletion of /opt/stack/data/nova/instances/ff35ef10-9b97-4082-bf02-8fa4d9db9063_del complete
Nov 15 21:37:47 user nova-compute[75409]: INFO nova.compute.manager [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:37:47 user nova-compute[75409]: INFO nova.compute.manager [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Rescuing
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:37:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:48 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Took 0.93 seconds to deallocate network for instance.
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-4fd0296a-3b0a-4edd-ae65-d1f59c805919 req-84745e0a-5e65-4edf-a4b0-9c5d6e161cae service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-deleted-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:48 user nova-compute[75409]: INFO nova.compute.manager [req-4fd0296a-3b0a-4edd-ae65-d1f59c805919 req-84745e0a-5e65-4edf-a4b0-9c5d6e161cae service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Neutron deleted interface 2c9dd991-6743-45f3-af24-cd08422d3843; detaching it from the instance and deleting it from the info cache
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-4fd0296a-3b0a-4edd-ae65-d1f59c805919 req-84745e0a-5e65-4edf-a4b0-9c5d6e161cae service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-4fd0296a-3b0a-4edd-ae65-d1f59c805919 req-84745e0a-5e65-4edf-a4b0-9c5d6e161cae service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Detach interface failed, port_id=2c9dd991-6743-45f3-af24-cd08422d3843, reason: Instance ff35ef10-9b97-4082-bf02-8fa4d9db9063 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] Acquiring lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] No waiting events found dispatching network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:48 user nova-compute[75409]: WARNING nova.compute.manager [req-fa0a4676-7eaa-4404-aca2-1a3cc8aa962c req-47d32106-226e-43c6-acc4-3057d8cb4d56 service nova] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Received unexpected event network-vif-plugged-2c9dd991-6743-45f3-af24-cd08422d3843 for instance with vm_state active and task_state deleting.
Nov 15 21:37:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:48 user nova-compute[75409]: WARNING nova.compute.manager [req-3fd16b51-544e-47b7-b58c-14c0fca5f944 req-86495ad7-113a-492b-9ffd-9ac726b4df57 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state active and task_state rescuing.
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:37:48 user nova-compute[75409]: INFO nova.compute.manager [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] [instance: ff35ef10-9b97-4082-bf02-8fa4d9db9063] Took 0.89 seconds to detach 1 volumes for instance.
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance destroyed successfully.
Nov 15 21:37:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Attempting rescue
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:37:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Creating image(s)
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'trusted_certs' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue" returned: 0 in 0.053s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'migration_context' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<270fd5bf-1d83-42f3-80b9-b92a5f29fcbd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start _get_guest_xml network_info=[{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:a9:23:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<270fd5bf-1d83-42f3-80b9-b92a5f29fcbd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'numa_topology' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<270fd5bf-1d83-42f3-80b9-b92a5f29fcbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:37:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'vcpu_model' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Deleted allocations for instance ff35ef10-9b97-4082-bf02-8fa4d9db9063
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<270fd5bf-1d83-42f3-80b9-b92a5f29fcbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578225289',display_name='tempest-ServerRescueNegativeTestJSON-server-578225289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578225289',id=24,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-cx08850c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:33:11Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=270fd5bf-1d83-42f3-80b9-b92a5f29fcbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:a9:23:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:a9:23:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<270fd5bf-1d83-42f3-80b9-b92a5f29fcbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:37:49 user nova-compute[75409]:   <uuid>270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</uuid>
Nov 15 21:37:49 user nova-compute[75409]:   <name>instance-00000018</name>
Nov 15 21:37:49 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:37:49 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:37:49 user nova-compute[75409]:   <metadata>
Nov 15 21:37:49 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:37:49 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578225289</nova:name>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:37:49</nova:creationTime>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:37:49 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:37:49 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:owner>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:37:49 user nova-compute[75409]:       </nova:owner>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:37:49 user nova-compute[75409]:       <nova:ports>
Nov 15 21:37:49 user nova-compute[75409]:         <nova:port uuid="c3ccfd5c-9505-4387-b41c-b782d3722549">
Nov 15 21:37:49 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:37:49 user nova-compute[75409]:         </nova:port>
Nov 15 21:37:49 user nova-compute[75409]:       </nova:ports>
Nov 15 21:37:49 user nova-compute[75409]:     </nova:instance>
Nov 15 21:37:49 user nova-compute[75409]:   </metadata>
Nov 15 21:37:49 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:37:49 user nova-compute[75409]:     <system>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="serial">270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</entry>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="uuid">270fd5bf-1d83-42f3-80b9-b92a5f29fcbd</entry>
Nov 15 21:37:49 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:37:49 user nova-compute[75409]:     </system>
Nov 15 21:37:49 user nova-compute[75409]:   </sysinfo>
Nov 15 21:37:49 user nova-compute[75409]:   <os>
Nov 15 21:37:49 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:37:49 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:37:49 user nova-compute[75409]:   </os>
Nov 15 21:37:49 user nova-compute[75409]:   <features>
Nov 15 21:37:49 user nova-compute[75409]:     <acpi/>
Nov 15 21:37:49 user nova-compute[75409]:     <apic/>
Nov 15 21:37:49 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:37:49 user nova-compute[75409]:   </features>
Nov 15 21:37:49 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:37:49 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:37:49 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:37:49 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:37:49 user nova-compute[75409]:   </clock>
Nov 15 21:37:49 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:37:49 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:37:49 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:37:49 user nova-compute[75409]:   </cpu>
Nov 15 21:37:49 user nova-compute[75409]:   <devices>
Nov 15 21:37:49 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:37:49 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:37:49 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue"/>
Nov 15 21:37:49 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:37:49 user nova-compute[75409]:     </disk>
Nov 15 21:37:49 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:37:49 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:37:49 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk"/>
Nov 15 21:37:49 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:37:49 user nova-compute[75409]:     </disk>
Nov 15 21:37:49 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:37:49 user nova-compute[75409]:       <mac address="fa:16:3e:a9:23:6b"/>
Nov 15 21:37:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:37:49 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:37:49 user nova-compute[75409]:       <target dev="tapc3ccfd5c-95"/>
Nov 15 21:37:49 user nova-compute[75409]:     </interface>
Nov 15 21:37:49 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:37:49 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/console.log" append="off"/>
Nov 15 21:37:49 user nova-compute[75409]:     </serial>
Nov 15 21:37:49 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:37:49 user nova-compute[75409]:     <video>
Nov 15 21:37:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:37:49 user nova-compute[75409]:     </video>
Nov 15 21:37:49 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:37:49 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:37:49 user nova-compute[75409]:     </rng>
Nov 15 21:37:49 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:37:49 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:37:49 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:37:49 user nova-compute[75409]:     </memballoon>
Nov 15 21:37:49 user nova-compute[75409]:   </devices>
Nov 15 21:37:49 user nova-compute[75409]: </domain>
Nov 15 21:37:49 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:37:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance destroyed successfully.
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-74455848-6525-460f-b5e2-35d6f07c7248 tempest-ServerActionsTestOtherB-729308147 tempest-ServerActionsTestOtherB-729308147-project-member] Lock "ff35ef10-9b97-4082-bf02-8fa4d9db9063" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.707s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:a9:23:6b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:50 user nova-compute[75409]: WARNING nova.compute.manager [req-b8b5fac3-bfb8-41e4-ab6d-72e3f2ec498e req-0729b4ab-9b00-498b-a0c7-5ac34c180fc7 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state active and task_state rescuing.
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:37:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8073MB free_disk=25.20675277709961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fad92565-0779-43a4-9c78-8985a4fb59b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e76992cb-1288-4d56-b821-10232ba24eb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:52 user nova-compute[75409]: WARNING nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state active and task_state rescuing.
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:37:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:37:52 user nova-compute[75409]: WARNING nova.compute.manager [req-63d33ff4-e768-488c-a157-ef8954cf1a61 req-7c965a24-5f79-43af-bcb0-5873ea051c6c service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state active and task_state rescuing.
Nov 15 21:37:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bb5e8e6a-2dc0-4294-945c-41a22f2d4f16 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:37:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:37:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:37:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:20 user nova-compute[75409]: INFO nova.compute.manager [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Detaching volume 0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:38:20 user nova-compute[75409]: INFO nova.virt.block_device [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Attempting to driver detach volume 0d530565-171b-4081-9bef-78c0a53f0408 from mountpoint /dev/vdb
Nov 15 21:38:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Attempting to detach device vdb from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:38:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:38:20 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:38:20 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:38:20 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:38:20 user nova-compute[75409]:   <serial>0d530565-171b-4081-9bef-78c0a53f0408</serial>
Nov 15 21:38:20 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:38:20 user nova-compute[75409]: </disk>
Nov 15 21:38:20 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:38:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully detached device vdb from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the persistent domain config.
Nov 15 21:38:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:38:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:38:20 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:38:20 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:38:20 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:38:20 user nova-compute[75409]:   <serial>0d530565-171b-4081-9bef-78c0a53f0408</serial>
Nov 15 21:38:20 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:38:20 user nova-compute[75409]: </disk>
Nov 15 21:38:20 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:38:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:38:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-changed-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Refreshing instance network info cache due to event network-changed-5e4f6a53-1bce-4dfc-abab-dde886553ad8. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:38:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] Acquiring lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] Acquired lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:30 user nova-compute[75409]: DEBUG nova.network.neutron [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Refreshing network info cache for port 5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:38:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updated VIF entry in instance network info cache for port 5e4f6a53-1bce-4dfc-abab-dde886553ad8. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:38:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-10177b00-01aa-4ca2-b1fa-7d3cd66727dd req-ccccf677-bac1-46e9-b0fe-32b8c33e7d3b service nova] Releasing lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:33 user nova-compute[75409]: INFO nova.compute.manager [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Attaching volume 58bc0e01-8db0-4435-bdef-de12613eaa5b to /dev/vdb
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.utils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee800f4b-8af7-42f4-98ed-d110e5779641]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a4322-65ca-4002-b577-4101818634e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404e494-2c95-4b41-a562-1b30b62bb3ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837fd34-6d76-42da-9dae-f6dc0de03c72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:38:33 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:38:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea58c2e-3531-40ad-a1ca-de357ba59cf7]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG os_brick.utils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:38:33 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating existing volume attachment record: 0db1fd12-7d86-4295-9686-5ace78b6b335 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:38:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-changed-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Refreshing instance network info cache due to event network-changed-ca4228d2-1d97-4972-bdab-81f633463018. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] Acquiring lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] Acquired lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Refreshing network info cache for port ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:38:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updated VIF entry in instance network info cache for port ca4228d2-1d97-4972-bdab-81f633463018. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:38:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updating instance_info_cache with network_info: [{"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2577b02f-c37c-4d0d-9c9b-1c97228a0bbd req-bff6b9a6-3ac7-4ce4-a1f6-a96761402a36 service nova] Releasing lock "refresh_cache-fad92565-0779-43a4-9c78-8985a4fb59b2" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzebSJTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:38:38 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:38:38 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:38:38 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd232d8e-ca43-4eff-bbba-38d79a3e47ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:38:38 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb17928-c3d5-4629-a89d-f69fa78aca48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b] added
Nov 15 21:38:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[115bbd14-892b-4ec3-ab55-89a20a20983a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac345432-cf5f-490a-99c0-22e1351bb474]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzebSJTf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzebSJTf" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2265d8-09de-4593-a5d5-96b793718456]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzebSJTf'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8ddeb-ae69-4fb9-9284-fa4980d0dfd7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ccb43c-1d67-4a50-9dc2-041f192d082e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a46cd3-5c98-432d-8b37-9d714d39b695]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260]
Nov 15 21:38:39 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260] successful.
Nov 15 21:38:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d0626-7c92-4c80-9b41-41f0fac32cb5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce467202-cc65-4cd7-b263-7c5d5385672d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:39 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:39 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf098e42-9f5e-481f-9682-186cf511ec99]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzebSJTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:38:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23739353264383931', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739353264383931', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:38:40 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:38:40 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:38:40 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:38:40 user nova-compute[75409]:   <serial>58bc0e01-8db0-4435-bdef-de12613eaa5b</serial>
Nov 15 21:38:40 user nova-compute[75409]: </disk>
Nov 15 21:38:40 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:e4:a9:0d, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:38:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7587da94-5096-4e37-838f-11ef83f21e49 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.263s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ee81e967-0218-462c-adb0-fb459b0cad43 is timed out.
Nov 15 21:38:41 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully detached device vdb from instance ee81e967-0218-462c-adb0-fb459b0cad43 from the live domain config.
Nov 15 21:38:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shTYiBXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:38:41 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb5998-a2c6-4a52-b191-27f3b288eeff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:38:41 user nova-compute[75409]: No targets found.
Nov 15 21:38:41 user nova-compute[75409]: iSNS:
Nov 15 21:38:41 user nova-compute[75409]: No targets found.
Nov 15 21:38:41 user nova-compute[75409]: STATIC:
Nov 15 21:38:41 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:38:41 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:38:41 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:38:41 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:38:41 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:38:41 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:38:41 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4
Nov 15 21:38:41 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:38:41 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:38:41 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408
Nov 15 21:38:41 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:38:41 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:38:41 user nova-compute[75409]: FIRMWARE:
Nov 15 21:38:41 user nova-compute[75409]: No targets found.
Nov 15 21:38:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:38:41 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:38:41 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[287bc82e-798c-442f-a3f6-efa8361415f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcfef7e-256a-4da8-a1bf-8b30162c4be8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:41 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9e9070-2368-4dd1-ad54-84bb6be26d88]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b606e4b-dddb-4785-8716-ecffebcb853a]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd2b7d-f011-4c25-927e-2864ceb60f0a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6a792-cf12-4720-ae62-ede60236a43b]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fc44d-f64d-49bc-ba23-0d3906fac130]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd199a0-cef3-4560-b2d3-d1cc1754095d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260]
Nov 15 21:38:41 user nova-compute[75409]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408, portal: 172.16.0.220,3260] successful.
Nov 15 21:38:41 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d530565-171b-4081-9bef-78c0a53f0408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cee240-22ae-4248-b055-0e668f659f38]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== disconnect_volume: return (364ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:38:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:42 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'flavor' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e71bf20a-afc2-4e3a-9c4c-a90446c8fe9e tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.819s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:38:43 user nova-compute[75409]: INFO nova.compute.claims [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Claim successful on node user
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:38:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:38:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:44 user nova-compute[75409]: INFO nova.virt.block_device [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Booting with volume snapshot 9c5adc1e-5adf-4fd1-a875-a1a14bb57b86 at /dev/vda
Nov 15 21:38:44 user nova-compute[75409]: DEBUG nova.policy [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:38:44 user nova-compute[75409]: INFO nova.compute.claims [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Claim successful on node user
Nov 15 21:38:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Successfully created port: 140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:38:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.policy [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752b5dc398bb45608817b61c4ccbfb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d9e1e2556e4ec396ccabb7f7126bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:38:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Creating image(s)
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "/opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk 1073741824" returned: 0 in 0.058s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Successfully created port: 9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Successfully updated port: 140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-changed-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Refreshing instance network info cache due to event network-changed-140810ff-6af6-4fc4-81df-7bed16a388f1. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] Acquiring lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Cannot resize image /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Ensure instance console log exists: /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updating instance_info_cache with network_info: [{"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Instance network_info: |[{"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] Acquired lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Refreshing network info cache for port 140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Successfully updated port: 9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquired lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-changed-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Refreshing instance network info cache due to event network-changed-9373ff63-1919-4d80-9a57-d16acc3bce94. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] Acquiring lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updated VIF entry in instance network info cache for port 140810ff-6af6-4fc4-81df-7bed16a388f1. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updating instance_info_cache with network_info: [{"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updating instance_info_cache with network_info: [{"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-89a118aa-c9cc-4c2b-9fd2-a12a000458fa req-262653ae-e936-47bb-a77e-514dd819b840 service nova] Releasing lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Releasing lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Instance network_info: |[{"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] Acquired lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Refreshing network info cache for port 9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Start _get_guest_xml network_info=[{"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:38:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:46 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1942794434',display_name='tempest-AttachVolumeNegativeTest-server-1942794434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1942794434',id=32,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4vRZHGB/JCArPFgGt64D1p+flYCoOC3Bxt0ZRydIu/Aa706Hue1d9YbIPUrUh9pkPFZHvUA+AaUqTQ61pNYEuc0SsuB2JrBvzbUFL02aBIf9TssIF3NhfqnovcSyGCNw==',key_name='tempest-keypair-78389742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-f6uhpet3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=56e8fbb3-37d9-4914-a0de-03dca76c33c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'pci_devices' on Instance uuid 56e8fbb3-37d9-4914-a0de-03dca76c33c6 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:38:46 user nova-compute[75409]:   <uuid>56e8fbb3-37d9-4914-a0de-03dca76c33c6</uuid>
Nov 15 21:38:46 user nova-compute[75409]:   <name>instance-00000020</name>
Nov 15 21:38:46 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:38:46 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:38:46 user nova-compute[75409]:   <metadata>
Nov 15 21:38:46 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:38:46 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1942794434</nova:name>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:38:46</nova:creationTime>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:38:46 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:38:46 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:owner>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:user uuid="752b5dc398bb45608817b61c4ccbfb8b">tempest-AttachVolumeNegativeTest-1984244406-project-member</nova:user>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:project uuid="45d9e1e2556e4ec396ccabb7f7126bf0">tempest-AttachVolumeNegativeTest-1984244406</nova:project>
Nov 15 21:38:46 user nova-compute[75409]:       </nova:owner>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:38:46 user nova-compute[75409]:       <nova:ports>
Nov 15 21:38:46 user nova-compute[75409]:         <nova:port uuid="9373ff63-1919-4d80-9a57-d16acc3bce94">
Nov 15 21:38:46 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:38:46 user nova-compute[75409]:         </nova:port>
Nov 15 21:38:46 user nova-compute[75409]:       </nova:ports>
Nov 15 21:38:46 user nova-compute[75409]:     </nova:instance>
Nov 15 21:38:46 user nova-compute[75409]:   </metadata>
Nov 15 21:38:46 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:38:46 user nova-compute[75409]:     <system>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="serial">56e8fbb3-37d9-4914-a0de-03dca76c33c6</entry>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="uuid">56e8fbb3-37d9-4914-a0de-03dca76c33c6</entry>
Nov 15 21:38:46 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:38:46 user nova-compute[75409]:     </system>
Nov 15 21:38:46 user nova-compute[75409]:   </sysinfo>
Nov 15 21:38:46 user nova-compute[75409]:   <os>
Nov 15 21:38:46 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:38:46 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:38:46 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:38:46 user nova-compute[75409]:   </os>
Nov 15 21:38:46 user nova-compute[75409]:   <features>
Nov 15 21:38:46 user nova-compute[75409]:     <acpi/>
Nov 15 21:38:46 user nova-compute[75409]:     <apic/>
Nov 15 21:38:46 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:38:46 user nova-compute[75409]:   </features>
Nov 15 21:38:46 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:38:46 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:38:46 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:38:46 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:38:46 user nova-compute[75409]:   </clock>
Nov 15 21:38:46 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:38:46 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:38:46 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:38:46 user nova-compute[75409]:   </cpu>
Nov 15 21:38:46 user nova-compute[75409]:   <devices>
Nov 15 21:38:46 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:38:46 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:38:46 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk"/>
Nov 15 21:38:46 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:38:46 user nova-compute[75409]:     </disk>
Nov 15 21:38:46 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:38:46 user nova-compute[75409]:       <mac address="fa:16:3e:df:78:84"/>
Nov 15 21:38:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:46 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:38:46 user nova-compute[75409]:       <target dev="tap9373ff63-19"/>
Nov 15 21:38:46 user nova-compute[75409]:     </interface>
Nov 15 21:38:46 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:38:46 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/console.log" append="off"/>
Nov 15 21:38:46 user nova-compute[75409]:     </serial>
Nov 15 21:38:46 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:38:46 user nova-compute[75409]:     <video>
Nov 15 21:38:46 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:46 user nova-compute[75409]:     </video>
Nov 15 21:38:46 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:38:46 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:38:46 user nova-compute[75409]:     </rng>
Nov 15 21:38:46 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:38:46 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:38:46 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:38:46 user nova-compute[75409]:     </memballoon>
Nov 15 21:38:46 user nova-compute[75409]:   </devices>
Nov 15 21:38:46 user nova-compute[75409]: </domain>
Nov 15 21:38:46 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1942794434',display_name='tempest-AttachVolumeNegativeTest-server-1942794434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1942794434',id=32,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4vRZHGB/JCArPFgGt64D1p+flYCoOC3Bxt0ZRydIu/Aa706Hue1d9YbIPUrUh9pkPFZHvUA+AaUqTQ61pNYEuc0SsuB2JrBvzbUFL02aBIf9TssIF3NhfqnovcSyGCNw==',key_name='tempest-keypair-78389742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-f6uhpet3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=56e8fbb3-37d9-4914-a0de-03dca76c33c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG os_vif [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c38b8dd2-d94a-58b4-bd51-c0f8f17d3751', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9373ff63-19, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9373ff63-19, col_values=(('qos', UUID('779f9817-d48d-4e7b-9312-49c035aac5c1')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9373ff63-19, col_values=(('external_ids', {'iface-id': '9373ff63-1919-4d80-9a57-d16acc3bce94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:78:84', 'vm-uuid': '56e8fbb3-37d9-4914-a0de-03dca76c33c6'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:46 user nova-compute[75409]: INFO os_vif [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19')
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:38:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:df:78:84, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:38:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updated VIF entry in instance network info cache for port 9373ff63-1919-4d80-9a57-d16acc3bce94. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:38:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updating instance_info_cache with network_info: [{"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b2930ee8-3474-407e-bbb7-1374e940de6e req-e60c040c-6624-4382-8027-6b3926d6676c service nova] Releasing lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:38:48 user nova-compute[75409]: WARNING nova.compute.manager [req-5871b800-2257-4627-8286-5a61feba6daa req-ea7918da-7353-4083-8ca4-4983f0134326 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state building and task_state spawning.
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:38:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8df694-f7c3-4645-a170-4f5727622c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea58d6-f913-4b49-bc81-0d03add85bd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9246c17-9253-46e3-96e4-15309baeef07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a76eee-a504-4dd8-8538-9ed09f58c184]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:38:50 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2bd846-47e7-40f2-b1c5-989ddb77e093]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updating existing volume attachment record: 06065ec5-3e6b-47c9-aab3-dc1e0cf2f70c {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:38:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Instance spawned successfully.
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: INFO nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:38:50 user nova-compute[75409]: INFO nova.compute.manager [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Took 6.09 seconds to build instance.
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:38:50 user nova-compute[75409]: WARNING nova.compute.manager [req-c5a11d66-43ef-4194-a414-5f5c13e73f5a req-d93e587a-f642-4bed-b81f-2dcaa79f4a99 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state active and task_state None.
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba580c47-3e23-4293-80f3-f24149a2212b tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.192s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:38:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8102MB free_disk=25.20191192626953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ee81e967-0218-462c-adb0-fb459b0cad43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fad92565-0779-43a4-9c78-8985a4fb59b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e76992cb-1288-4d56-b821-10232ba24eb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c861aee1-006d-4126-b9f0-7bd618b60905 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 56e8fbb3-37d9-4914-a0de-03dca76c33c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:38:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:38:54 user nova-compute[75409]: INFO nova.compute.claims [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Claim successful on node user
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:38:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.policy [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e867fa9de5b345518d1e7bea923f8e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbce891b648d4fa299edae25edf1965a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:38:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Creating image(s)
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk 1073741824" returned: 0 in 0.048s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Successfully created port: 9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:38:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Creating image(s)
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Ensure instance console log exists: /opt/stack/data/nova/instances/c861aee1-006d-4126-b9f0-7bd618b60905/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Start _get_guest_xml network_info=[{"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T21:38:39Z,direct_url=<?>,disk_format='qcow2',id=0e871d7f-fdde-43fa-9656-24259a4da96d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1309584798',owner='81bbdc35dddf43868e00e37786d69e6c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T21:38:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHyjBrNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c861aee1-006d-4126-b9f0-7bd618b60905', 'attached_at': '', 'detached_at': '', 'volume_id': '117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 'serial': '117dec07-8e4b-45b6-9d0b-f7c88c4e7182'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '06065ec5-3e6b-47c9-aab3-dc1e0cf2f70c', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:38:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T21:38:39Z,direct_url=<?>,disk_format='qcow2',id=0e871d7f-fdde-43fa-9656-24259a4da96d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1309584798',owner='81bbdc35dddf43868e00e37786d69e6c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T21:38:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHyjBrNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:38:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:38:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:38:56 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd06d38-9231-45af-97dc-858e21f99c4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:38:56 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f49ca-8854-4036-99bf-8697a3aed486]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182] added
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d442f2-4680-4446-b791-a794abf9c56d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be33ef2-9825-433c-9d72-ee30a9f3fa5f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHyjBrNC {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHyjBrNC" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260fb18-5f1d-4a51-9261-c1dba86cd476]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHyjBrNC'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347b420-86d2-4b9e-9e33-ab6bb9854c41]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39876e6-62d1-46b2-adfe-96bb5aade748]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[24250f52-e38b-408d-b895-843c562fa283]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260]
Nov 15 21:38:56 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260] successful.
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf34233-2fee-4333-a92a-044aa4614396]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d547a-37e4-4e4f-b147-429faf193ed0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:38:56 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:38:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a113b8-f31f-44cd-b37a-b4670eda7020]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Successfully updated port: 9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-changed-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Refreshing instance network info cache due to event network-changed-9c482854-d245-4c9e-8092-5e046c8ea6b2. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance network_info: |[{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Refreshing network info cache for port 9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start _get_guest_xml network_info=[{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:38:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:38:56 user nova-compute[75409]:   <uuid>f3c2a748-56e5-49bb-bc58-a0fb96706fda</uuid>
Nov 15 21:38:56 user nova-compute[75409]:   <name>instance-00000021</name>
Nov 15 21:38:56 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:38:56 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:38:56 user nova-compute[75409]:   <metadata>
Nov 15 21:38:56 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:38:56 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeTestJSON-server-1716788624</nova:name>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:38:56</nova:creationTime>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:38:56 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:38:56 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:owner>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:user uuid="e867fa9de5b345518d1e7bea923f8e55">tempest-AttachVolumeTestJSON-753726309-project-member</nova:user>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:project uuid="fbce891b648d4fa299edae25edf1965a">tempest-AttachVolumeTestJSON-753726309</nova:project>
Nov 15 21:38:56 user nova-compute[75409]:       </nova:owner>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:38:56 user nova-compute[75409]:       <nova:ports>
Nov 15 21:38:56 user nova-compute[75409]:         <nova:port uuid="9c482854-d245-4c9e-8092-5e046c8ea6b2">
Nov 15 21:38:56 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:38:56 user nova-compute[75409]:         </nova:port>
Nov 15 21:38:56 user nova-compute[75409]:       </nova:ports>
Nov 15 21:38:56 user nova-compute[75409]:     </nova:instance>
Nov 15 21:38:56 user nova-compute[75409]:   </metadata>
Nov 15 21:38:56 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:38:56 user nova-compute[75409]:     <system>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="serial">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="uuid">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:38:56 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:38:56 user nova-compute[75409]:     </system>
Nov 15 21:38:56 user nova-compute[75409]:   </sysinfo>
Nov 15 21:38:56 user nova-compute[75409]:   <os>
Nov 15 21:38:56 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:38:56 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:38:56 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:38:56 user nova-compute[75409]:   </os>
Nov 15 21:38:56 user nova-compute[75409]:   <features>
Nov 15 21:38:56 user nova-compute[75409]:     <acpi/>
Nov 15 21:38:56 user nova-compute[75409]:     <apic/>
Nov 15 21:38:56 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:38:56 user nova-compute[75409]:   </features>
Nov 15 21:38:56 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:38:56 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:38:56 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:38:56 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:38:56 user nova-compute[75409]:   </clock>
Nov 15 21:38:56 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:38:56 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:38:56 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:38:56 user nova-compute[75409]:   </cpu>
Nov 15 21:38:56 user nova-compute[75409]:   <devices>
Nov 15 21:38:56 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:38:56 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:38:56 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk"/>
Nov 15 21:38:56 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:38:56 user nova-compute[75409]:     </disk>
Nov 15 21:38:56 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:38:56 user nova-compute[75409]:       <mac address="fa:16:3e:e7:6a:61"/>
Nov 15 21:38:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:56 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:38:56 user nova-compute[75409]:       <target dev="tap9c482854-d2"/>
Nov 15 21:38:56 user nova-compute[75409]:     </interface>
Nov 15 21:38:56 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:38:56 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/console.log" append="off"/>
Nov 15 21:38:56 user nova-compute[75409]:     </serial>
Nov 15 21:38:56 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:38:56 user nova-compute[75409]:     <video>
Nov 15 21:38:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:56 user nova-compute[75409]:     </video>
Nov 15 21:38:56 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:38:56 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:38:56 user nova-compute[75409]:     </rng>
Nov 15 21:38:56 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:38:56 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:38:56 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:38:56 user nova-compute[75409]:     </memballoon>
Nov 15 21:38:56 user nova-compute[75409]:   </devices>
Nov 15 21:38:56 user nova-compute[75409]: </domain>
Nov 15 21:38:56 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG os_vif [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c976385a-d566-5cea-a715-286d16b4be5f', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c482854-d2, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c482854-d2, col_values=(('qos', UUID('62fd0228-2aaf-4d0e-9de5-4ef2577f6b24')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c482854-d2, col_values=(('external_ids', {'iface-id': '9c482854-d245-4c9e-8092-5e046c8ea6b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6a:61', 'vm-uuid': 'f3c2a748-56e5-49bb-bc58-a0fb96706fda'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: INFO os_vif [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No VIF found with MAC fa:16:3e:e7:6a:61, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHyjBrNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23564623164626461', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564623164626461', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updated VIF entry in instance network info cache for port 9c482854-d245-4c9e-8092-5e046c8ea6b2. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6de5769b-cb04-4746-9367-a4e720ac6256 req-4e5d5a48-9256-4c02-a893-b301c499ab74 service nova] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1384876687',id=31,image_ref='0e871d7f-fdde-43fa-9656-24259a4da96d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdAM1eJMb/sMhxumE37ESRL5Jy6a0WxVoo1BS2J34yiilMAS+vsJntHFP2rhUXkk/BhTmwtxfJ2DURc6W2vI5j38GriMD97IjP0sck5jJauN2iyOZIPU48DCW6YkhY4CQ==',key_name='tempest-keypair-432997113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-85ra97nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2009063389',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=c861aee1-006d-4126-b9f0-7bd618b60905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid c861aee1-006d-4126-b9f0-7bd618b60905 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:38:57 user nova-compute[75409]:   <uuid>c861aee1-006d-4126-b9f0-7bd618b60905</uuid>
Nov 15 21:38:57 user nova-compute[75409]:   <name>instance-0000001f</name>
Nov 15 21:38:57 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:38:57 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:38:57 user nova-compute[75409]:   <metadata>
Nov 15 21:38:57 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:38:57 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1384876687</nova:name>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:38:56</nova:creationTime>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:38:57 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:38:57 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:owner>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:38:57 user nova-compute[75409]:       </nova:owner>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:root type="image" uuid="0e871d7f-fdde-43fa-9656-24259a4da96d"/>
Nov 15 21:38:57 user nova-compute[75409]:       <nova:ports>
Nov 15 21:38:57 user nova-compute[75409]:         <nova:port uuid="140810ff-6af6-4fc4-81df-7bed16a388f1">
Nov 15 21:38:57 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 21:38:57 user nova-compute[75409]:         </nova:port>
Nov 15 21:38:57 user nova-compute[75409]:       </nova:ports>
Nov 15 21:38:57 user nova-compute[75409]:     </nova:instance>
Nov 15 21:38:57 user nova-compute[75409]:   </metadata>
Nov 15 21:38:57 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:38:57 user nova-compute[75409]:     <system>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="serial">c861aee1-006d-4126-b9f0-7bd618b60905</entry>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="uuid">c861aee1-006d-4126-b9f0-7bd618b60905</entry>
Nov 15 21:38:57 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:38:57 user nova-compute[75409]:     </system>
Nov 15 21:38:57 user nova-compute[75409]:   </sysinfo>
Nov 15 21:38:57 user nova-compute[75409]:   <os>
Nov 15 21:38:57 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:38:57 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:38:57 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:38:57 user nova-compute[75409]:   </os>
Nov 15 21:38:57 user nova-compute[75409]:   <features>
Nov 15 21:38:57 user nova-compute[75409]:     <acpi/>
Nov 15 21:38:57 user nova-compute[75409]:     <apic/>
Nov 15 21:38:57 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:38:57 user nova-compute[75409]:   </features>
Nov 15 21:38:57 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:38:57 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:38:57 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:38:57 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:38:57 user nova-compute[75409]:   </clock>
Nov 15 21:38:57 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:38:57 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:38:57 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:38:57 user nova-compute[75409]:   </cpu>
Nov 15 21:38:57 user nova-compute[75409]:   <devices>
Nov 15 21:38:57 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:38:57 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:38:57 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:38:57 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:38:57 user nova-compute[75409]:       <serial>117dec07-8e4b-45b6-9d0b-f7c88c4e7182</serial>
Nov 15 21:38:57 user nova-compute[75409]:     </disk>
Nov 15 21:38:57 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:38:57 user nova-compute[75409]:       <mac address="fa:16:3e:30:0e:56"/>
Nov 15 21:38:57 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:57 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:38:57 user nova-compute[75409]:       <target dev="tap140810ff-6a"/>
Nov 15 21:38:57 user nova-compute[75409]:     </interface>
Nov 15 21:38:57 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:38:57 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/c861aee1-006d-4126-b9f0-7bd618b60905/console.log" append="off"/>
Nov 15 21:38:57 user nova-compute[75409]:     </serial>
Nov 15 21:38:57 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:38:57 user nova-compute[75409]:     <video>
Nov 15 21:38:57 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:38:57 user nova-compute[75409]:     </video>
Nov 15 21:38:57 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:38:57 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:38:57 user nova-compute[75409]:     </rng>
Nov 15 21:38:57 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:38:57 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:38:57 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:38:57 user nova-compute[75409]:     </memballoon>
Nov 15 21:38:57 user nova-compute[75409]:   </devices>
Nov 15 21:38:57 user nova-compute[75409]: </domain>
Nov 15 21:38:57 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1384876687',id=31,image_ref='0e871d7f-fdde-43fa-9656-24259a4da96d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdAM1eJMb/sMhxumE37ESRL5Jy6a0WxVoo1BS2J34yiilMAS+vsJntHFP2rhUXkk/BhTmwtxfJ2DURc6W2vI5j38GriMD97IjP0sck5jJauN2iyOZIPU48DCW6YkhY4CQ==',key_name='tempest-keypair-432997113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-85ra97nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2009063389',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=c861aee1-006d-4126-b9f0-7bd618b60905,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG os_vif [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3346959f-4116-52a7-b2e5-acd520867d3a', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap140810ff-6a, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap140810ff-6a, col_values=(('qos', UUID('6c064ffc-d1da-4316-811e-149c211afecc')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap140810ff-6a, col_values=(('external_ids', {'iface-id': '140810ff-6af6-4fc4-81df-7bed16a388f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:0e:56', 'vm-uuid': 'c861aee1-006d-4126-b9f0-7bd618b60905'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:57 user nova-compute[75409]: INFO os_vif [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a')
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:38:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:30:0e:56, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:38:59 user nova-compute[75409]: WARNING nova.compute.manager [req-24b276e2-f760-4b35-8d36-e2c136f4b9c9 req-0cb4b46f-75c5-4603-ad53-2c47597896d2 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state building and task_state spawning.
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] No waiting events found dispatching network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:38:59 user nova-compute[75409]: WARNING nova.compute.manager [req-1847d615-512a-4ca8-9e09-f8b29b3c9b20 req-816cf0fd-de64-47d7-a0ab-4c6c424b2bdd service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received unexpected event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 for instance with vm_state building and task_state spawning.
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:38:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:01 user nova-compute[75409]: WARNING nova.compute.manager [req-ed908366-db5a-4fdd-9fe3-2a8603b98f7d req-74895fa3-7b4f-469d-8a28-5ff9ca051bda service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state building and task_state spawning.
Nov 15 21:39:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] No waiting events found dispatching network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:01 user nova-compute[75409]: WARNING nova.compute.manager [req-206588a3-2e4a-4c90-8a01-7894e09385c3 req-3eacdcdb-a5c9-4690-9f69-2c7021c830b3 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received unexpected event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 for instance with vm_state building and task_state spawning.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Instance spawned successfully.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance spawned successfully.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.compute.manager [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Took 18.66 seconds to build instance.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d5fb513c-589c-4425-a898-a0754c425cff tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.772s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Took 7.28 seconds to spawn the instance on the hypervisor.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:39:02 user nova-compute[75409]: INFO nova.compute.manager [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Took 8.14 seconds to build instance.
Nov 15 21:39:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-26ba5300-26bb-479f-b882-40f6a7a867cc tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.250s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing instance network info cache due to event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updated VIF entry in instance network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3db35a43-4c6a-43b7-ac70-7df81accc86e req-837190d7-b327-4df5-8bf5-0ec9e8e98c98 service nova] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:10 user nova-compute[75409]: INFO nova.compute.manager [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Shelve offloading
Nov 15 21:39:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:11 user nova-compute[75409]: WARNING nova.compute.manager [req-9746728c-59ae-433b-84c9-35f3e2072a65 req-723087ca-e32f-43df-839d-9f5e617d617b service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state active and task_state shelving.
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:11 user nova-compute[75409]: INFO nova.compute.manager [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Terminating instance
Nov 15 21:39:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance destroyed successfully.
Nov 15 21:39:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-64ffcd6a-432f-4729-b6af-ed5b30f90ac1 req-f692b01c-b260-4134-bb6c-7b64a8821b13 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-unplugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:39:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Instance destroyed successfully.
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'resources' on Instance uuid ee81e967-0218-462c-adb0-fb459b0cad43 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-149324729',display_name='tempest-ServerActionsTestOtherA-server-877530731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-149324729',id=26,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp3fDCf3t8XazkBr66D7ztR7uPkKXaoA5xY3GEAtTrH22sSenWd3Rs+NOatOAF19QSeIWfFMdWet6feMpfKA4Aa3KBwD9P6wmVieNoejwIKQ0yM7nOf1JeSkc4S7rezoQ==',key_name='tempest-keypair-1041839114',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:35:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-pqemh5vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=ee81e967-0218-462c-adb0-fb459b0cad43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a014045-0efc-4989-a690-a3af9b14cc48", "address": "fa:16:3e:ee:c8:e8", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a014045-0e", "ovs_interfaceid": "3a014045-0efc-4989-a690-a3af9b14cc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG os_vif [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a014045-0e, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=189f5f10-7ade-4746-b55f-2f36dd5a3f28) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:12 user nova-compute[75409]: INFO os_vif [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c8:e8,bridge_name='br-int',has_traffic_filtering=True,id=3a014045-0efc-4989-a690-a3af9b14cc48,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a014045-0e')
Nov 15 21:39:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Deleting instance files /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43_del
Nov 15 21:39:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Deletion of /opt/stack/data/nova/instances/ee81e967-0218-462c-adb0-fb459b0cad43_del complete
Nov 15 21:39:12 user nova-compute[75409]: INFO nova.compute.manager [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 21:39:12 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:39:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance destroyed successfully.
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.objects.instance [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'resources' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT+V+solto7CW75MJneGFUQj+CHR8ovATiaLIQZ3t99se9MgA/t8ZQ6Ap6SfN9VNZkLNJHya6NApaIZF/KlS6tyWYZgqJWLSjE3+a9pe7Mwl1peyiIhqi0nm912lK5KTQ==',key_name='tempest-TestShelveInstance-1229559182',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:37:29Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_vif [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78a30fb2-95, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=474e71a3-aeb7-473d-9397-bef5cb1d269c) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:39:13 user nova-compute[75409]: INFO os_vif [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95')
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:39:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049858a-a8e0-4a83-a004-fcd249878439]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:39:13 user nova-compute[75409]: No targets found.
Nov 15 21:39:13 user nova-compute[75409]: iSNS:
Nov 15 21:39:13 user nova-compute[75409]: No targets found.
Nov 15 21:39:13 user nova-compute[75409]: STATIC:
Nov 15 21:39:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:39:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:39:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:39:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182
Nov 15 21:39:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:39:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:39:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:39:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:39:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:39:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4
Nov 15 21:39:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:39:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:39:13 user nova-compute[75409]: FIRMWARE:
Nov 15 21:39:13 user nova-compute[75409]: No targets found.
Nov 15 21:39:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:39:13 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:39:13 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a03f41-9236-4512-b7e6-9b0daab9e45b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae86248-aee9-4718-b0d9-ddbee46d9d9e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:39:13 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:39:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf4816c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86754a3-4554-4bc9-a2ce-0c5112fa8d04]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05a789d-f337-4d52-b3d9-156ca4063d94]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Took 0.93 seconds to deallocate network for instance.
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b478f2a-d10f-44fc-92ab-14ca363fd49b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-1a3b217b-4624-43c0-811d-b93a577fe51e req-ae0e8f8f-7e27-4642-a327-9f5e56e0bef5 service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-deleted-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:13 user nova-compute[75409]: WARNING nova.compute.manager [req-da12cecb-26ea-438c-8f5e-b21b44bc3e0a req-4ae79225-c9cf-4be0-a6a0-5761f2f2dbd1 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state active and task_state shelving.
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5cc05-adcb-422c-af86-f7ceb88dec1a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae01b9-3635-4ea7-a0f9-fe9b818ac45f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.460s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d48dba-b3f4-4bde-9350-bf864a5d4bfd]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]
Nov 15 21:39:13 user nova-compute[75409]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.
Nov 15 21:39:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df62e3-1dad-4457-833e-13bceff2ab33]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.803s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== disconnect_volume: return (805ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:39:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:39:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deleting instance files /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9_del
Nov 15 21:39:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deletion of /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9_del complete
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Acquiring lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Lock "ee81e967-0218-462c-adb0-fb459b0cad43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] No waiting events found dispatching network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:14 user nova-compute[75409]: WARNING nova.compute.manager [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: ee81e967-0218-462c-adb0-fb459b0cad43] Received unexpected event network-vif-plugged-3a014045-0efc-4989-a690-a3af9b14cc48 for instance with vm_state deleted and task_state None.
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing instance network info cache due to event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.809s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:14 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Deleted allocations for instance ee81e967-0218-462c-adb0-fb459b0cad43
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1d09ab7b-6974-440a-ac28-5051a67daac7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "ee81e967-0218-462c-adb0-fb459b0cad43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.990s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updated VIF entry in instance network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": null, "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap78a30fb2-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e8bef76d-8438-49c0-a1bf-3f4344324548 req-b3d8e154-0651-462d-ac32-0d672a77f90e service nova] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:39:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:15 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Deleted allocations for instance e76992cb-1288-4d56-b821-10232ba24eb9
Nov 15 21:39:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'numa_topology' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG nova.objects.base [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Object Instance<e76992cb-1288-4d56-b821-10232ba24eb9> lazy-loaded attributes: resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-42d9d556-295e-402d-a72d-32989a3e14eb tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.833s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:38 user nova-compute[75409]: INFO nova.compute.manager [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Unrescuing
Nov 15 21:39:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:39:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:39:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'flavor' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG nova.compute.manager [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:39 user nova-compute[75409]: WARNING nova.compute.manager [req-436b192b-8346-460d-8d94-88a25445b947 req-a0342f00-0fc0-4ddf-afb5-5c767a52498e service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:39:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance destroyed successfully.
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:41 user nova-compute[75409]: WARNING nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:41 user nova-compute[75409]: WARNING nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:39:41 user nova-compute[75409]: WARNING nova.compute.manager [req-0782ebcf-60f3-4305-9163-738bd1d43710 req-96a2337c-d53b-4fb5-9453-26f1ce801558 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:39:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cec19b3f-b453-40e5-84c9-2457955dfa3e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:39:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:39:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:39:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:39:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.15976333618164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fad92565-0779-43a4-9c78-8985a4fb59b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance c861aee1-006d-4126-b9f0-7bd618b60905 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 56e8fbb3-37d9-4914-a0de-03dca76c33c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:39:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:39:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:39:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:39:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-changed-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Refreshing instance network info cache due to event network-changed-140810ff-6af6-4fc4-81df-7bed16a388f1. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] Acquiring lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] Acquired lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG nova.network.neutron [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Refreshing network info cache for port 140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:34 user nova-compute[75409]: INFO nova.compute.manager [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Terminating instance
Nov 15 21:40:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updated VIF entry in instance network info cache for port 140810ff-6af6-4fc4-81df-7bed16a388f1. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updating instance_info_cache with network_info: [{"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d0d6cfcf-b3d9-4251-8b42-18a48492c217 req-bfa2a45e-355b-4747-9172-bfc54eea7d60 service nova] Releasing lock "refresh_cache-c861aee1-006d-4126-b9f0-7bd618b60905" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-unplugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] No waiting events found dispatching network-vif-unplugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-08c31bc7-0b2c-4724-9c60-d9e97b8a2d29 req-05faa732-3656-4627-82f0-37deed5fa888 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-unplugged-140810ff-6af6-4fc4-81df-7bed16a388f1 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:40:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Instance destroyed successfully.
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid c861aee1-006d-4126-b9f0-7bd618b60905 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1384876687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1384876687',id=31,image_ref='0e871d7f-fdde-43fa-9656-24259a4da96d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdAM1eJMb/sMhxumE37ESRL5Jy6a0WxVoo1BS2J34yiilMAS+vsJntHFP2rhUXkk/BhTmwtxfJ2DURc6W2vI5j38GriMD97IjP0sck5jJauN2iyOZIPU48DCW6YkhY4CQ==',key_name='tempest-keypair-432997113',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-85ra97nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2009063389',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=c861aee1-006d-4126-b9f0-7bd618b60905,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "140810ff-6af6-4fc4-81df-7bed16a388f1", "address": "fa:16:3e:30:0e:56", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140810ff-6a", "ovs_interfaceid": "140810ff-6af6-4fc4-81df-7bed16a388f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_vif [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap140810ff-6a, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c064ffc-d1da-4316-811e-149c211afecc) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:35 user nova-compute[75409]: INFO os_vif [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:0e:56,bridge_name='br-int',has_traffic_filtering=True,id=140810ff-6af6-4fc4-81df-7bed16a388f1,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140810ff-6a')
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHyjBrNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:40:35 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: INFO nova.compute.manager [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Terminating instance
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c3945-6d6d-4383-9918-e4248273f472]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:40:35 user nova-compute[75409]: No targets found.
Nov 15 21:40:35 user nova-compute[75409]: iSNS:
Nov 15 21:40:35 user nova-compute[75409]: No targets found.
Nov 15 21:40:35 user nova-compute[75409]: STATIC:
Nov 15 21:40:35 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182
Nov 15 21:40:35 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:40:35 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:40:35 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:40:35 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:40:35 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:40:35 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4
Nov 15 21:40:35 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:40:35 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:40:35 user nova-compute[75409]: FIRMWARE:
Nov 15 21:40:35 user nova-compute[75409]: No targets found.
Nov 15 21:40:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:40:35 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:40:35 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99011811-a314-4c10-9d9a-3f01a6cbb833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[402e2ea0-1afe-44b6-9b78-dffb09e008da]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:35 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:35 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:40:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:35 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:35 user nova-compute[75409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 (non-flash)
Nov 15 21:40:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80c76a-4994-4c74-915d-43987fe1ebc4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7fa48-0ff0-481d-b6df-f07bd2c19277]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f405539-55c6-492c-b667-aefeac2277ec]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a0ef6-326d-476e-a4d6-bd5c2b10347a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c868c8-ed7c-4838-9427-1fa41797dc16]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf1e1e-6530-4c76-a076-d908680572c5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260]
Nov 15 21:40:35 user nova-compute[75409]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182, portal: 172.16.0.220,3260] successful.
Nov 15 21:40:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:117dec07-8e4b-45b6-9d0b-f7c88c4e7182 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc7a5f-b51e-4fab-bb5b-14f7bb336c90]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (340ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:40:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Deleting instance files /opt/stack/data/nova/instances/c861aee1-006d-4126-b9f0-7bd618b60905_del
Nov 15 21:40:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Deletion of /opt/stack/data/nova/instances/c861aee1-006d-4126-b9f0-7bd618b60905_del complete
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:35 user nova-compute[75409]: INFO nova.compute.manager [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 21:40:35 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:40:35 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Instance destroyed successfully.
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.objects.instance [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'resources' on Instance uuid 56e8fbb3-37d9-4914-a0de-03dca76c33c6 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1942794434',display_name='tempest-AttachVolumeNegativeTest-server-1942794434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1942794434',id=32,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4vRZHGB/JCArPFgGt64D1p+flYCoOC3Bxt0ZRydIu/Aa706Hue1d9YbIPUrUh9pkPFZHvUA+AaUqTQ61pNYEuc0SsuB2JrBvzbUFL02aBIf9TssIF3NhfqnovcSyGCNw==',key_name='tempest-keypair-78389742',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-f6uhpet3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=56e8fbb3-37d9-4914-a0de-03dca76c33c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG os_vif [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9373ff63-19, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=779f9817-d48d-4e7b-9312-49c035aac5c1) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:36 user nova-compute[75409]: INFO os_vif [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:84,bridge_name='br-int',has_traffic_filtering=True,id=9373ff63-1919-4d80-9a57-d16acc3bce94,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9373ff63-19')
Nov 15 21:40:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Deleting instance files /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6_del
Nov 15 21:40:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Deletion of /opt/stack/data/nova/instances/56e8fbb3-37d9-4914-a0de-03dca76c33c6_del complete
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: INFO nova.compute.manager [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 21:40:36 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-changed-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Refreshing instance network info cache due to event network-changed-9373ff63-1919-4d80-9a57-d16acc3bce94. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Acquiring lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Acquired lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Refreshing network info cache for port 9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:36 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Took 0.81 seconds to deallocate network for instance.
Nov 15 21:40:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc9f195b-fc0f-4959-aa8c-a430d86f2945 req-ce4aaff2-ced6-425c-ba80-c23df0490383 service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-deleted-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updated VIF entry in instance network info cache for port 9373ff63-1919-4d80-9a57-d16acc3bce94. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updating instance_info_cache with network_info: [{"id": "9373ff63-1919-4d80-9a57-d16acc3bce94", "address": "fa:16:3e:df:78:84", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9373ff63-19", "ovs_interfaceid": "9373ff63-1919-4d80-9a57-d16acc3bce94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] Acquiring lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] Lock "c861aee1-006d-4126-b9f0-7bd618b60905-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] No waiting events found dispatching network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:37 user nova-compute[75409]: WARNING nova.compute.manager [req-f7dc4429-ea97-40a4-8053-f3ee499785ba req-4cb0ece1-6ca3-4782-91f3-7221582d015c service nova] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Received unexpected event network-vif-plugged-140810ff-6af6-4fc4-81df-7bed16a388f1 for instance with vm_state active and task_state deleting.
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Releasing lock "refresh_cache-56e8fbb3-37d9-4914-a0de-03dca76c33c6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:37 user nova-compute[75409]: WARNING nova.compute.manager [req-2cd6732b-7be5-4863-a40f-4bf185d404d6 req-ea2c9b5e-5037-40d5-889c-d37afc64aa54 service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state active and task_state deleting.
Nov 15 21:40:37 user nova-compute[75409]: INFO nova.compute.manager [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Took 0.79 seconds to detach 1 volumes for instance.
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: c861aee1-006d-4126-b9f0-7bd618b60905] Deleting volume: 117dec07-8e4b-45b6-9d0b-f7c88c4e7182 {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:40:37 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:37 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Took 1.54 seconds to deallocate network for instance.
Nov 15 21:40:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance c861aee1-006d-4126-b9f0-7bd618b60905
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-eecf7aa3-c00c-464e-86b8-17a4fccebc63 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "c861aee1-006d-4126-b9f0-7bd618b60905" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.401s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Deleted allocations for instance 56e8fbb3-37d9-4914-a0de-03dca76c33c6
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-da591d9e-02ba-4d44-895c-6445768d70f9 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.880s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:38 user nova-compute[75409]: WARNING nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state deleted and task_state None.
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:38 user nova-compute[75409]: WARNING nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state deleted and task_state None.
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:38 user nova-compute[75409]: WARNING nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-unplugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state deleted and task_state None.
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Acquiring lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] Lock "56e8fbb3-37d9-4914-a0de-03dca76c33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] No waiting events found dispatching network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:38 user nova-compute[75409]: WARNING nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received unexpected event network-vif-plugged-9373ff63-1919-4d80-9a57-d16acc3bce94 for instance with vm_state deleted and task_state None.
Nov 15 21:40:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-e9a6bd7e-1233-4c1d-a14e-2754b5a49b76 req-868008f1-0b8a-447b-a089-45af7c7ca1ef service nova] [instance: 56e8fbb3-37d9-4914-a0de-03dca76c33c6] Received event network-vif-deleted-9373ff63-1919-4d80-9a57-d16acc3bce94 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:40:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:40:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-changed-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Refreshing instance network info cache due to event network-changed-9c482854-d245-4c9e-8092-5e046c8ea6b2. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Refreshing network info cache for port 9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updated VIF entry in instance network info cache for port 9c482854-d245-4c9e-8092-5e046c8ea6b2. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8aa027b1-0edd-4392-8e5b-27daa37f6387 req-1209cbe2-c2e2-4084-8241-be8032bc6765 service nova] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:40:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:48 user nova-compute[75409]: INFO nova.compute.manager [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Attaching volume 11793d7a-934c-4cef-8653-56509884bff3 to /dev/vdb
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.utils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38cca8b-97e2-4886-a07a-164e90822d44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764cc0d-45d9-41c3-bebf-1c5526f6a1e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d29dc1-1a15-4b73-a94f-cbb90a920192]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681d0c1-4bc1-4246-aec2-acad43e0385d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:40:48 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:40:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c5b3c-086f-42cf-9389-87889cf0e679]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG os_brick.utils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:40:48 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating existing volume attachment record: 503e7282-8fa4-4634-86e6-56e6ea552a1b {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:40:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:40:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:40:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8306MB free_disk=25.184696197509766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance fad92565-0779-43a4-9c78-8985a4fb59b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:40:53 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:40:53 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:40:53 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30e794-b177-410c-b00c-ecba38ca9c09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:40:53 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6816f-eb61-48a5-b661-f2b98d48b2cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3] added
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[167182d0-10c3-436e-8f03-67019df622c8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3405431-602f-4fe8-86a9-2c4596805d44]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfbMDqB {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfbMDqB" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4cdace-011b-46e6-9889-9da00839f960]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXfbMDqB'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93199f-b281-47b5-9772-b7bce46ad29d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c35d127-f80a-4be9-aeb0-d681bd96b23c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fdfaec-0274-471a-b65e-904183a0b8b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]
Nov 15 21:40:53 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb82339-8f9d-49ad-aeb8-c26516c47095]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[432bc877-9b1e-475e-b7f6-91ccf51d396e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:40:53 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:40:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b52ad9-ece6-4322-a2fe-9d71c0d6617f]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:40:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [{"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26262376430366335', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262376430366335', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:40:54 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:40:54 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:40:54 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:40:54 user nova-compute[75409]:   <serial>11793d7a-934c-4cef-8653-56509884bff3</serial>
Nov 15 21:40:54 user nova-compute[75409]: </disk>
Nov 15 21:40:54 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:40:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No VIF found with MAC fa:16:3e:e7:6a:61, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-c6acdd79-e7c8-4e29-a95e-d0686c029517 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.080s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75409) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:40:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:56 user nova-compute[75409]: WARNING nova.compute.manager [req-16979e9b-f7cf-4e74-a705-50d7564c89ee req-453860af-5ece-47cc-9d5e-f8926f93f241 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state active and task_state powering-off.
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:40:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance destroyed successfully.
Nov 15 21:40:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:40:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4115e6fd-cdc8-43c8-809b-1d8f67c5ee5b tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.835s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:40:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:40:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:40:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:40:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:40:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:40:58 user nova-compute[75409]: WARNING nova.compute.manager [req-667bcc46-6a37-4f3f-913b-84ec78a5369a req-79723775-43dd-4667-a342-12c34d3b5606 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:40:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:02 user nova-compute[75409]: INFO nova.compute.manager [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Unshelving
Nov 15 21:41:02 user nova-compute[75409]: INFO nova.virt.block_device [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Booting with volume 8601d547-ec5f-4cbc-b7dc-0e6c41655f20 at /dev/vda
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.utils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee9fac-3ee5-48ce-ba67-f6a7aae83b9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da60dc3-773f-4b0a-8842-acc6c4af4c60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b54fa2-9dd0-427c-9307-4c2df4b90aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab9ab1-7d99-4437-b7cd-70e7b2fd99d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:41:02 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:41:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb7c8f-a6fc-44c7-bf65-904390c32c4a]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG os_brick.utils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:02 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating existing volume attachment record: c6172177-d3b3-4bd7-9d5b-f89b8ce83794 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:41:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:41:07 user nova-compute[75409]: INFO nova.compute.claims [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Claim successful on node user
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.288s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'pci_requests' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'numa_topology' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:41:08 user nova-compute[75409]: INFO nova.compute.claims [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Claim successful on node user
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:41:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.policy [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae40e5bccb84c50a4c93963d56469f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d130f253b745e2ac2497eebbd4cf99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:41:08 user nova-compute[75409]: INFO nova.virt.block_device [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Booting with volume 9feba7af-9dc3-4715-a55b-0ae384ab891b at /dev/vda
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b134af-4e00-4cef-8cb7-aacd0ab7db29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[303566c8-e981-4048-bfb9-1449919f2146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d7d20-fecd-4b94-95a9-3b97ef8ccb8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d091f4-310a-47f2-91a5-1d1334935965]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:41:08 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b81292-338c-4184-bda0-d4eaad18aaf3]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating existing volume attachment record: fd51b282-5dad-4e48-bd9e-bd4cc36b1f4a {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:08 user nova-compute[75409]: INFO nova.network.neutron [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating port 78a30fb2-9596-40d3-babb-d53e874d7f95 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 21:41:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Successfully created port: 0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing instance network info cache due to event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Successfully updated port: 0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:41:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:41:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Creating image(s)
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start _get_guest_xml network_info=[{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e76992cb-1288-4d56-b821-10232ba24eb9', 'attached_at': '', 'detached_at': '', 'volume_id': '8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'serial': '8601d547-ec5f-4cbc-b7dc-0e6c41655f20'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'c6172177-d3b3-4bd7-9d5b-f89b8ce83794', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:41:10 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:10 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.objects.instance [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'vcpu_model' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.objects.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Object Instance<e76992cb-1288-4d56-b821-10232ba24eb9> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:10 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:10 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36b877-ef1a-4da0-a125-de5d2717f8ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:41:10 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[167415bf-a939-4e78-a1c9-c823d1e1daa8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20] added
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade7fa3d-9dd0-4903-95b9-20840542bac0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4dcfc-a600-456c-8178-093056149264]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPCnedoN {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPCnedoN" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[447bb767-c5f4-4306-abe6-998a723cfc41]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPCnedoN'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de0f3ff-8760-4208-9b6b-7eb3ccb1c771]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e1b6d-130b-44ff-9f5d-f6a07f003658]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda9f9d-d7f4-403e-96fb-ccadbd9a2502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]
Nov 15 21:41:10 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dd6b48-ebe6-47be-80b9-e0dea65eb0ae]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b8776-32f6-4c9f-a805-6857c3e822d8]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:10 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance network_info: |[{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8588f-bfdb-47cd-b95f-8dcff1ad3e7a]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updated VIF entry in instance network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3aca1dea-46e5-4d09-82e0-cf57447980bc req-eae61b54-8c24-4375-9860-64f35ed971eb service nova] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-changed-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Refreshing instance network info cache due to event network-changed-0dcbe4d7-e100-44f5-97f6-a299379d2246. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.network.neutron [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Refreshing network info cache for port 0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23637396664373163', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637396664373163', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1229559182',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:41:02Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.objects.instance [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'pci_devices' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.objects.base [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Object Instance<e76992cb-1288-4d56-b821-10232ba24eb9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:41:11 user nova-compute[75409]:   <uuid>e76992cb-1288-4d56-b821-10232ba24eb9</uuid>
Nov 15 21:41:11 user nova-compute[75409]:   <name>instance-0000001e</name>
Nov 15 21:41:11 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:41:11 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:41:11 user nova-compute[75409]:   <metadata>
Nov 15 21:41:11 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:41:11 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:41:11 user nova-compute[75409]:       <nova:name>tempest-TestShelveInstance-server-2099334093</nova:name>
Nov 15 21:41:11 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:41:10</nova:creationTime>
Nov 15 21:41:11 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:41:11 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:41:11 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:41:11 user nova-compute[75409]:       <nova:owner>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:user uuid="61b68c1d5a1f42f09cfe7ba3b860d40d">tempest-TestShelveInstance-67678213-project-member</nova:user>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:project uuid="2379b1b186a54fac907d4e4f270f1bdc">tempest-TestShelveInstance-67678213</nova:project>
Nov 15 21:41:11 user nova-compute[75409]:       </nova:owner>
Nov 15 21:41:11 user nova-compute[75409]:       <nova:ports>
Nov 15 21:41:11 user nova-compute[75409]:         <nova:port uuid="78a30fb2-9596-40d3-babb-d53e874d7f95">
Nov 15 21:41:11 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:41:11 user nova-compute[75409]:         </nova:port>
Nov 15 21:41:11 user nova-compute[75409]:       </nova:ports>
Nov 15 21:41:11 user nova-compute[75409]:     </nova:instance>
Nov 15 21:41:11 user nova-compute[75409]:   </metadata>
Nov 15 21:41:11 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:41:11 user nova-compute[75409]:     <system>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="serial">e76992cb-1288-4d56-b821-10232ba24eb9</entry>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="uuid">e76992cb-1288-4d56-b821-10232ba24eb9</entry>
Nov 15 21:41:11 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:41:11 user nova-compute[75409]:     </system>
Nov 15 21:41:11 user nova-compute[75409]:   </sysinfo>
Nov 15 21:41:11 user nova-compute[75409]:   <os>
Nov 15 21:41:11 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:41:11 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:41:11 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:41:11 user nova-compute[75409]:   </os>
Nov 15 21:41:11 user nova-compute[75409]:   <features>
Nov 15 21:41:11 user nova-compute[75409]:     <acpi/>
Nov 15 21:41:11 user nova-compute[75409]:     <apic/>
Nov 15 21:41:11 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:41:11 user nova-compute[75409]:   </features>
Nov 15 21:41:11 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:41:11 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:41:11 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:41:11 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:41:11 user nova-compute[75409]:   </clock>
Nov 15 21:41:11 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:41:11 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:41:11 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:41:11 user nova-compute[75409]:   </cpu>
Nov 15 21:41:11 user nova-compute[75409]:   <devices>
Nov 15 21:41:11 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:41:11 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:41:11 user nova-compute[75409]:       <source dev="/dev/sde"/>
Nov 15 21:41:11 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:41:11 user nova-compute[75409]:       <serial>8601d547-ec5f-4cbc-b7dc-0e6c41655f20</serial>
Nov 15 21:41:11 user nova-compute[75409]:     </disk>
Nov 15 21:41:11 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:41:11 user nova-compute[75409]:       <mac address="fa:16:3e:45:1f:ae"/>
Nov 15 21:41:11 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:11 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:41:11 user nova-compute[75409]:       <target dev="tap78a30fb2-95"/>
Nov 15 21:41:11 user nova-compute[75409]:     </interface>
Nov 15 21:41:11 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:41:11 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9/console.log" append="off"/>
Nov 15 21:41:11 user nova-compute[75409]:     </serial>
Nov 15 21:41:11 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:41:11 user nova-compute[75409]:     <video>
Nov 15 21:41:11 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:11 user nova-compute[75409]:     </video>
Nov 15 21:41:11 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:41:11 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:41:11 user nova-compute[75409]:     </rng>
Nov 15 21:41:11 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:41:11 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:41:11 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:41:11 user nova-compute[75409]:     </memballoon>
Nov 15 21:41:11 user nova-compute[75409]:   </devices>
Nov 15 21:41:11 user nova-compute[75409]: </domain>
Nov 15 21:41:11 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1229559182',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:41:02Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG os_vif [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9909a887-36a5-5a41-b86b-d30121b953dd', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78a30fb2-95, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78a30fb2-95, col_values=(('qos', UUID('87997c9b-2c87-4bf8-ba02-fe8bdacfb595')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78a30fb2-95, col_values=(('external_ids', {'iface-id': '78a30fb2-9596-40d3-babb-d53e874d7f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:1f:ae', 'vm-uuid': 'e76992cb-1288-4d56-b821-10232ba24eb9'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:11 user nova-compute[75409]: INFO os_vif [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95')
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:41:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] No VIF found with MAC fa:16:3e:45:1f:ae, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:41:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updated VIF entry in instance network info cache for port 0dcbe4d7-e100-44f5-97f6-a299379d2246. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:41:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-82b6ef2c-87b4-441f-a6d4-1eb24dd3dc00 req-5b30ed29-28fa-43b2-b5ea-077542fc1962 service nova] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:41:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Creating image(s)
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Ensure instance console log exists: /opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start _get_guest_xml network_info=[{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07498a3f-f560-46db-9ac2-f466c7080d9c', 'attached_at': '', 'detached_at': '', 'volume_id': '9feba7af-9dc3-4715-a55b-0ae384ab891b', 'serial': '9feba7af-9dc3-4715-a55b-0ae384ab891b'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'fd51b282-5dad-4e48-bd9e-bd4cc36b1f4a', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:41:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:13 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:13 user nova-compute[75409]: WARNING nova.compute.manager [req-93eb3410-1e59-4935-8cb5-15a1fc64cc35 req-cec39618-2431-4938-a2a0-9b4e1859c7a6 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab6901-46f4-4119-8fd7-93234ccb9450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:41:13 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: WARNING nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid fad92565-0779-43a4-9c78-8985a4fb59b2 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 07498a3f-f560-46db-9ac2-f466c7080d9c {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d0c5a-126f-41bd-ac3b-19e9326b8c0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b] added
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f324135-b49d-4b37-837f-7c387d578d96]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac651392-3b7d-4121-8339-0c85e508d276]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trwBEcju {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trwBEcju" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad1f14-b52c-4998-8293-b951c12eb17d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'trwBEcju'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29fc89-9308-40c2-9c13-1c22631f3ffb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba53915-f7d6-48d4-b7e4-d854a37dd679]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f477b6f-cbb0-485a-9c48-a945b220eaf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]
Nov 15 21:41:13 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[028218eb-63cf-4667-a5ea-c8a08996fbe4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65ae0e-b524-4e7a-bb06-2fd6579c5d47]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:13 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f6a84-96c1-42ca-96aa-3b1d5f65d659]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:41:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23361363832386165', 'path': '/dev/sdf'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361363832386165', 'path': '/dev/sdf'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:14 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'pci_devices' on Instance uuid 07498a3f-f560-46db-9ac2-f466c7080d9c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:41:15 user nova-compute[75409]:   <uuid>07498a3f-f560-46db-9ac2-f466c7080d9c</uuid>
Nov 15 21:41:15 user nova-compute[75409]:   <name>instance-00000022</name>
Nov 15 21:41:15 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:41:15 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:41:15 user nova-compute[75409]:   <metadata>
Nov 15 21:41:15 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:41:15 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:41:15 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherA-server-1004802004</nova:name>
Nov 15 21:41:15 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:41:13</nova:creationTime>
Nov 15 21:41:15 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:41:15 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:41:15 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:41:15 user nova-compute[75409]:       <nova:owner>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:user uuid="4ae40e5bccb84c50a4c93963d56469f9">tempest-ServerActionsTestOtherA-1526007087-project-member</nova:user>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:project uuid="a8d130f253b745e2ac2497eebbd4cf99">tempest-ServerActionsTestOtherA-1526007087</nova:project>
Nov 15 21:41:15 user nova-compute[75409]:       </nova:owner>
Nov 15 21:41:15 user nova-compute[75409]:       <nova:ports>
Nov 15 21:41:15 user nova-compute[75409]:         <nova:port uuid="0dcbe4d7-e100-44f5-97f6-a299379d2246">
Nov 15 21:41:15 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:41:15 user nova-compute[75409]:         </nova:port>
Nov 15 21:41:15 user nova-compute[75409]:       </nova:ports>
Nov 15 21:41:15 user nova-compute[75409]:     </nova:instance>
Nov 15 21:41:15 user nova-compute[75409]:   </metadata>
Nov 15 21:41:15 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:41:15 user nova-compute[75409]:     <system>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="serial">07498a3f-f560-46db-9ac2-f466c7080d9c</entry>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="uuid">07498a3f-f560-46db-9ac2-f466c7080d9c</entry>
Nov 15 21:41:15 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:41:15 user nova-compute[75409]:     </system>
Nov 15 21:41:15 user nova-compute[75409]:   </sysinfo>
Nov 15 21:41:15 user nova-compute[75409]:   <os>
Nov 15 21:41:15 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:41:15 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:41:15 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:41:15 user nova-compute[75409]:   </os>
Nov 15 21:41:15 user nova-compute[75409]:   <features>
Nov 15 21:41:15 user nova-compute[75409]:     <acpi/>
Nov 15 21:41:15 user nova-compute[75409]:     <apic/>
Nov 15 21:41:15 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:41:15 user nova-compute[75409]:   </features>
Nov 15 21:41:15 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:41:15 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:41:15 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:41:15 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:41:15 user nova-compute[75409]:   </clock>
Nov 15 21:41:15 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:41:15 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:41:15 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:41:15 user nova-compute[75409]:   </cpu>
Nov 15 21:41:15 user nova-compute[75409]:   <devices>
Nov 15 21:41:15 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:41:15 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:41:15 user nova-compute[75409]:       <source dev="/dev/sdf"/>
Nov 15 21:41:15 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:41:15 user nova-compute[75409]:       <serial>9feba7af-9dc3-4715-a55b-0ae384ab891b</serial>
Nov 15 21:41:15 user nova-compute[75409]:     </disk>
Nov 15 21:41:15 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:41:15 user nova-compute[75409]:       <mac address="fa:16:3e:15:57:32"/>
Nov 15 21:41:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:15 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:41:15 user nova-compute[75409]:       <target dev="tap0dcbe4d7-e1"/>
Nov 15 21:41:15 user nova-compute[75409]:     </interface>
Nov 15 21:41:15 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:41:15 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c/console.log" append="off"/>
Nov 15 21:41:15 user nova-compute[75409]:     </serial>
Nov 15 21:41:15 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:41:15 user nova-compute[75409]:     <video>
Nov 15 21:41:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:15 user nova-compute[75409]:     </video>
Nov 15 21:41:15 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:41:15 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:41:15 user nova-compute[75409]:     </rng>
Nov 15 21:41:15 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:41:15 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:41:15 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:41:15 user nova-compute[75409]:     </memballoon>
Nov 15 21:41:15 user nova-compute[75409]:   </devices>
Nov 15 21:41:15 user nova-compute[75409]: </domain>
Nov 15 21:41:15 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG os_vif [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a893deba-7e97-5f8b-b7dd-0e3dcca7ca7e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcbe4d7-e1, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dcbe4d7-e1, col_values=(('qos', UUID('371f7ab0-4469-4e93-a234-5c48ef29b239')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dcbe4d7-e1, col_values=(('external_ids', {'iface-id': '0dcbe4d7-e100-44f5-97f6-a299379d2246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:57:32', 'vm-uuid': '07498a3f-f560-46db-9ac2-f466c7080d9c'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:15 user nova-compute[75409]: INFO os_vif [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1')
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:15:57:32, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:41:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance spawned successfully.
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-25841e0f-d187-44cc-aaf5-686697f5b680 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.031s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.779s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:15 user nova-compute[75409]: INFO nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:15 user nova-compute[75409]: WARNING nova.compute.manager [req-4fcdfc7b-4119-466b-b6b1-5084fbc2cd9b req-60e73d57-9216-428c-9ee4-8c4a814e04b0 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state active and task_state None.
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:16 user nova-compute[75409]: WARNING nova.compute.manager [req-4e98ba0a-dd60-4eda-9e68-4f4617c98db6 req-22ca7ce2-9d2d-4cf9-86da-d56516642a8b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state building and task_state spawning.
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:41:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance spawned successfully.
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:18 user nova-compute[75409]: WARNING nova.compute.manager [req-2fe1e67d-b5a5-4a14-b3ed-f53cab61b6a2 req-361bead6-10b8-421d-83b2-305d0d6e3f51 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state building and task_state spawning.
Nov 15 21:41:18 user nova-compute[75409]: INFO nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 15 21:41:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:41:18 user nova-compute[75409]: INFO nova.compute.manager [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Took 11.19 seconds to build instance.
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9e7e53ce-b6e4-42eb-9d6c-a6bc1ffeb7bc tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.292s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.150s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:18 user nova-compute[75409]: INFO nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 15 21:41:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:26 user nova-compute[75409]: INFO nova.compute.manager [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Detaching volume 58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:41:26 user nova-compute[75409]: INFO nova.virt.block_device [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Attempting to driver detach volume 58bc0e01-8db0-4435-bdef-de12613eaa5b from mountpoint /dev/vdb
Nov 15 21:41:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Attempting to detach device vdb from instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:41:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:41:26 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:41:26 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:41:26 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:41:26 user nova-compute[75409]:   <serial>58bc0e01-8db0-4435-bdef-de12613eaa5b</serial>
Nov 15 21:41:26 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:41:26 user nova-compute[75409]: </disk>
Nov 15 21:41:26 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:41:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 from the persistent domain config.
Nov 15 21:41:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:41:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:41:26 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:41:26 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:41:26 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:41:26 user nova-compute[75409]:   <serial>58bc0e01-8db0-4435-bdef-de12613eaa5b</serial>
Nov 15 21:41:26 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:41:26 user nova-compute[75409]: </disk>
Nov 15 21:41:26 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:27 user nova-compute[75409]: INFO nova.compute.manager [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Terminating instance
Nov 15 21:41:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-unplugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] No waiting events found dispatching network-vif-unplugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-05b3b42f-d262-4f2d-9c5d-859e463b0f66 req-f20f9ca4-cfaa-4e62-ab05-b6d0eb9dc4aa service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-unplugged-ca4228d2-1d97-4972-bdab-81f633463018 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:41:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Instance destroyed successfully.
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.objects.instance [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid fad92565-0779-43a4-9c78-8985a4fb59b2 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1292074125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1292074125',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAbSBlO+kebRXOnAVDg28AGF/3WElEZtJcVq8M763IbthW9GiR+393Z3wMNfUCgYNboXTaNotMLoKqFIr0+8XECTeSnUZSsmh+42tJNfMfBkiUmuJA0RWMHcqdyUkNhQg==',key_name='tempest-keypair-678695477',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:36:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-814rct3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=fad92565-0779-43a4-9c78-8985a4fb59b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ca4228d2-1d97-4972-bdab-81f633463018", "address": "fa:16:3e:78:7c:a1", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4228d2-1d", "ovs_interfaceid": "ca4228d2-1d97-4972-bdab-81f633463018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_vif [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4228d2-1d, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfab2a3a-ba4d-437b-a519-b44098f2bf65) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:28 user nova-compute[75409]: INFO os_vif [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=ca4228d2-1d97-4972-bdab-81f633463018,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4228d2-1d')
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCgipFIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:28 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f23eae-e354-4539-8057-1abf68891eb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:41:28 user nova-compute[75409]: No targets found.
Nov 15 21:41:28 user nova-compute[75409]: iSNS:
Nov 15 21:41:28 user nova-compute[75409]: No targets found.
Nov 15 21:41:28 user nova-compute[75409]: STATIC:
Nov 15 21:41:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:41:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:41:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:41:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:41:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4
Nov 15 21:41:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:28 user nova-compute[75409]: FIRMWARE:
Nov 15 21:41:28 user nova-compute[75409]: No targets found.
Nov 15 21:41:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:41:28 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:41:28 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37771a2-3ef7-467a-b839-8ecf437d0ab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32927bfd-9f1b-4fbc-a9b7-90566b4690f2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:28 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf08695fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c034019-f964-4d72-8824-bccfc3aa4657]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47fe42e-96ed-4848-bfc0-1b13667b021e]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0d99a-2a79-4916-9d91-a9b2c85bd095]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fbf885-e480-4138-814e-20d566e986ce]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8eb801-00f6-4d3b-8ddb-6a0d15641187]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b4744a-997b-45ec-9f05-cf37c3ec5cc2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260]
Nov 15 21:41:28 user nova-compute[75409]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4, portal: 172.16.0.220,3260] successful.
Nov 15 21:41:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[50038cfe-1102-4dd8-9fb2-f81dc28f8b4d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (348ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:41:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Deleting instance files /opt/stack/data/nova/instances/fad92565-0779-43a4-9c78-8985a4fb59b2_del
Nov 15 21:41:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Deletion of /opt/stack/data/nova/instances/fad92565-0779-43a4-9c78-8985a4fb59b2_del complete
Nov 15 21:41:28 user nova-compute[75409]: INFO nova.compute.manager [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 15 21:41:28 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:41:28 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:29 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Took 0.78 seconds to deallocate network for instance.
Nov 15 21:41:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] Acquiring lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] No waiting events found dispatching network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:29 user nova-compute[75409]: WARNING nova.compute.manager [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received unexpected event network-vif-plugged-ca4228d2-1d97-4972-bdab-81f633463018 for instance with vm_state active and task_state deleting.
Nov 15 21:41:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7f0cf5b4-3fa3-4c44-bb87-62d793ced120 req-88f9c4e8-da41-4e45-a716-e6408282698f service nova] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Received event network-vif-deleted-ca4228d2-1d97-4972-bdab-81f633463018 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:30 user nova-compute[75409]: INFO nova.compute.manager [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Took 0.86 seconds to detach 1 volumes for instance.
Nov 15 21:41:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: fad92565-0779-43a4-9c78-8985a4fb59b2] Deleting volume: 67d5450e-ab0a-4340-82d8-fd6e1d5c93f4 {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:41:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:41:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:41:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:30 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance fad92565-0779-43a4-9c78-8985a4fb59b2
Nov 15 21:41:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-442973c5-ac44-40d0-a516-990eb85ba98f tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "fad92565-0779-43a4-9c78-8985a4fb59b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.515s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:34 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:41:34 user nova-compute[75409]: INFO nova.compute.claims [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Claim successful on node user
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:41:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.policy [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cc4ebbfd85c43b78157cd50d8d4ef24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87098be8776c4e46abb1354048e23db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:41:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Creating image(s)
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk 1073741824" returned: 0 in 0.069s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:35 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Successfully created port: d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Cannot resize image /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Ensure instance console log exists: /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Successfully updated port: d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-changed-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing instance network info cache due to event network-changed-d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance network_info: |[{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.neutron [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing network info cache for port d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start _get_guest_xml network_info=[{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:41:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500346698',display_name='tempest-ServerRescueNegativeTestJSON-server-500346698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500346698',id=35,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESbsqe6k+BJfxjRCAjFpuLmFnEi5oy77GEeYOthZcY5F4vDxqfYdYv5F2l+z32Gs1Rc6yR9aVbYNQxfBQ5UlT814Q6EzsLAWsLmDF1wF0nIbqec0N/wfjWxiyss3cSKvw==',key_name='tempest-keypair-606468414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-tptdfn53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=d69ede3d-9720-4345-8d76-28aa6d731e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:41:36 user nova-compute[75409]:   <uuid>d69ede3d-9720-4345-8d76-28aa6d731e7d</uuid>
Nov 15 21:41:36 user nova-compute[75409]:   <name>instance-00000023</name>
Nov 15 21:41:36 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:41:36 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:41:36 user nova-compute[75409]:   <metadata>
Nov 15 21:41:36 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:41:36 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-500346698</nova:name>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:41:36</nova:creationTime>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:41:36 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:41:36 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:owner>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:41:36 user nova-compute[75409]:       </nova:owner>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:41:36 user nova-compute[75409]:       <nova:ports>
Nov 15 21:41:36 user nova-compute[75409]:         <nova:port uuid="d8004767-204a-4628-9f48-5febae9f752c">
Nov 15 21:41:36 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 21:41:36 user nova-compute[75409]:         </nova:port>
Nov 15 21:41:36 user nova-compute[75409]:       </nova:ports>
Nov 15 21:41:36 user nova-compute[75409]:     </nova:instance>
Nov 15 21:41:36 user nova-compute[75409]:   </metadata>
Nov 15 21:41:36 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:41:36 user nova-compute[75409]:     <system>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="serial">d69ede3d-9720-4345-8d76-28aa6d731e7d</entry>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="uuid">d69ede3d-9720-4345-8d76-28aa6d731e7d</entry>
Nov 15 21:41:36 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:41:36 user nova-compute[75409]:     </system>
Nov 15 21:41:36 user nova-compute[75409]:   </sysinfo>
Nov 15 21:41:36 user nova-compute[75409]:   <os>
Nov 15 21:41:36 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:41:36 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:41:36 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:41:36 user nova-compute[75409]:   </os>
Nov 15 21:41:36 user nova-compute[75409]:   <features>
Nov 15 21:41:36 user nova-compute[75409]:     <acpi/>
Nov 15 21:41:36 user nova-compute[75409]:     <apic/>
Nov 15 21:41:36 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:41:36 user nova-compute[75409]:   </features>
Nov 15 21:41:36 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:41:36 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:41:36 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:41:36 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:41:36 user nova-compute[75409]:   </clock>
Nov 15 21:41:36 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:41:36 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:41:36 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:41:36 user nova-compute[75409]:   </cpu>
Nov 15 21:41:36 user nova-compute[75409]:   <devices>
Nov 15 21:41:36 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:41:36 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:41:36 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk"/>
Nov 15 21:41:36 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:41:36 user nova-compute[75409]:     </disk>
Nov 15 21:41:36 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:41:36 user nova-compute[75409]:       <mac address="fa:16:3e:9e:b3:b8"/>
Nov 15 21:41:36 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:36 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:41:36 user nova-compute[75409]:       <target dev="tapd8004767-20"/>
Nov 15 21:41:36 user nova-compute[75409]:     </interface>
Nov 15 21:41:36 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:41:36 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/console.log" append="off"/>
Nov 15 21:41:36 user nova-compute[75409]:     </serial>
Nov 15 21:41:36 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:41:36 user nova-compute[75409]:     <video>
Nov 15 21:41:36 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:41:36 user nova-compute[75409]:     </video>
Nov 15 21:41:36 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:41:36 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:41:36 user nova-compute[75409]:     </rng>
Nov 15 21:41:36 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:41:36 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:41:36 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:41:36 user nova-compute[75409]:     </memballoon>
Nov 15 21:41:36 user nova-compute[75409]:   </devices>
Nov 15 21:41:36 user nova-compute[75409]: </domain>
Nov 15 21:41:36 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500346698',display_name='tempest-ServerRescueNegativeTestJSON-server-500346698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500346698',id=35,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESbsqe6k+BJfxjRCAjFpuLmFnEi5oy77GEeYOthZcY5F4vDxqfYdYv5F2l+z32Gs1Rc6yR9aVbYNQxfBQ5UlT814Q6EzsLAWsLmDF1wF0nIbqec0N/wfjWxiyss3cSKvw==',key_name='tempest-keypair-606468414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-tptdfn53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=d69ede3d-9720-4345-8d76-28aa6d731e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG os_vif [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a90da784-659b-5a38-9644-74fe1d45e784', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8004767-20, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8004767-20, col_values=(('qos', UUID('5b7fef5c-f200-4134-98ec-db99bc2f11ab')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8004767-20, col_values=(('external_ids', {'iface-id': 'd8004767-204a-4628-9f48-5febae9f752c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b3:b8', 'vm-uuid': 'd69ede3d-9720-4345-8d76-28aa6d731e7d'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:41:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:36 user nova-compute[75409]: INFO os_vif [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20')
Nov 15 21:41:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:41:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:9e:b3:b8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:41:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updated VIF entry in instance network info cache for port d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:41:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:41:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31ee721a-06f1-4368-ba53-772c21d4d0ec req-8d9c6123-2ff8-4ea2-a1e0-65db10fcb30c service nova] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:38 user nova-compute[75409]: WARNING nova.compute.manager [req-002331e6-8a0e-436f-b677-e976cc2c3cf8 req-2b5d8a96-f76f-49cf-9266-7ace895f0bcf service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state building and task_state spawning.
Nov 15 21:41:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:41:40 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance spawned successfully.
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:41:40 user nova-compute[75409]: INFO nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:41:40 user nova-compute[75409]: INFO nova.compute.manager [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Took 5.73 seconds to build instance.
Nov 15 21:41:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b2c09865-f66c-4159-aa65-b0f00a716037 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.830s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:41:40 user nova-compute[75409]: WARNING nova.compute.manager [req-d31e9a34-d7d3-4323-9d1e-9766280c6933 req-414cd028-8bd0-4971-89fc-fc337964c94b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state None.
Nov 15 21:41:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:41:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 is timed out.
Nov 15 21:41:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 from the live domain config.
Nov 15 21:41:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzebSJTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:41:47 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2197dd-b935-4bd9-b440-2b4e1e82f911]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:41:47 user nova-compute[75409]: No targets found.
Nov 15 21:41:47 user nova-compute[75409]: iSNS:
Nov 15 21:41:47 user nova-compute[75409]: No targets found.
Nov 15 21:41:47 user nova-compute[75409]: STATIC:
Nov 15 21:41:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:41:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:41:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:41:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b
Nov 15 21:41:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:41:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:41:47 user nova-compute[75409]: FIRMWARE:
Nov 15 21:41:47 user nova-compute[75409]: No targets found.
Nov 15 21:41:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:41:47 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:41:47 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1c1e4-eb25-4303-84a0-fa6295e7a562]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d6daf-65fb-4926-a42b-709877a5aecd]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:41:47 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:41:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf08694310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3fd63-2614-47db-869b-98cf323495f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bad206-7e6b-4824-9c59-9d719a79abd8]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18071fb-45cf-4f55-bf0f-67da8a56d24d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c232ba97-d781-48e4-8ea2-362d4f87ca05]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c604322e-9849-4be6-bdbf-31fa30d244c9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8afeb0-e04d-4f16-8292-6b88cd38351d]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260]
Nov 15 21:41:47 user nova-compute[75409]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b, portal: 172.16.0.220,3260] successful.
Nov 15 21:41:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bc0e01-8db0-4435-bdef-de12613eaa5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[569887bd-83a4-4c41-b803-3ffcf8768626]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== disconnect_volume: return (289ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:41:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:41:48 user nova-compute[75409]: DEBUG nova.objects.instance [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:41:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23027193-d4ad-4b5d-aa15-4d2b7a9fd793 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.786s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:41:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:41:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8132MB free_disk=25.17205810546875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e76992cb-1288-4d56-b821-10232ba24eb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:41:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:41:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:41:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:41:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:41:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:41:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:42:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:17 user nova-compute[75409]: INFO nova.compute.manager [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Terminating instance
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-unplugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] No waiting events found dispatching network-vif-unplugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-f0ff98d4-43b0-42e9-9320-da1ea1073251 req-ddadbfe2-48f6-4887-9193-3f300bb2fa9c service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-unplugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Instance destroyed successfully.
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'resources' on Instance uuid f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:36:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340960267',display_name='tempest-AttachVolumeNegativeTest-server-1340960267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1340960267',id=28,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8D2QA/Rz5v2A4FDlvUn583RX2I39mAvJVQm7eUwIkB8QM9KEma9gllxSn2U8ah9yKJv+7KNQZft8Bei5AgAU1slt8Mro7eteF+XyWNul0qZMwRKCeV//hoPl56khWF0Q==',key_name='tempest-keypair-1865124002',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-fvop1bc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=f2c3b14a-29bb-4a3f-a386-9e60aa156ed3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "address": "fa:16:3e:e4:a9:0d", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4f6a53-1b", "ovs_interfaceid": "5e4f6a53-1bce-4dfc-abab-dde886553ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG os_vif [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4f6a53-1b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb797f58-3e26-45de-a74a-e9d8a0bac0b3) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:17 user nova-compute[75409]: INFO os_vif [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a9:0d,bridge_name='br-int',has_traffic_filtering=True,id=5e4f6a53-1bce-4dfc-abab-dde886553ad8,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4f6a53-1b')
Nov 15 21:42:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Deleting instance files /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3_del
Nov 15 21:42:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Deletion of /opt/stack/data/nova/instances/f2c3b14a-29bb-4a3f-a386-9e60aa156ed3_del complete
Nov 15 21:42:18 user nova-compute[75409]: INFO nova.compute.manager [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 21:42:18 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:42:18 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:42:18 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:19 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Took 1.43 seconds to deallocate network for instance.
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-4df7bee9-f39d-4e97-a57a-01deb215d369 req-cba2b861-8689-4b3a-9534-365e07c1e89e service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-deleted-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:19 user nova-compute[75409]: INFO nova.compute.manager [req-4df7bee9-f39d-4e97-a57a-01deb215d369 req-cba2b861-8689-4b3a-9534-365e07c1e89e service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Neutron deleted interface 5e4f6a53-1bce-4dfc-abab-dde886553ad8; detaching it from the instance and deleting it from the info cache
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-4df7bee9-f39d-4e97-a57a-01deb215d369 req-cba2b861-8689-4b3a-9534-365e07c1e89e service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] Acquiring lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] No waiting events found dispatching network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:19 user nova-compute[75409]: WARNING nova.compute.manager [req-869f1ae4-d585-4b87-9e76-55e03fb53eaf req-3d0d2161-e842-49e3-aac2-d488042ac2f7 service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Received unexpected event network-vif-plugged-5e4f6a53-1bce-4dfc-abab-dde886553ad8 for instance with vm_state active and task_state deleting.
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-4df7bee9-f39d-4e97-a57a-01deb215d369 req-cba2b861-8689-4b3a-9534-365e07c1e89e service nova] [instance: f2c3b14a-29bb-4a3f-a386-9e60aa156ed3] Detach interface failed, port_id=5e4f6a53-1bce-4dfc-abab-dde886553ad8, reason: Instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:19 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Deleted allocations for instance f2c3b14a-29bb-4a3f-a386-9e60aa156ed3
Nov 15 21:42:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ab686b34-f66f-41f0-8487-30da5a44f27a tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "f2c3b14a-29bb-4a3f-a386-9e60aa156ed3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:25 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:42:25 user nova-compute[75409]: INFO nova.compute.claims [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Claim successful on node user
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:42:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.policy [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:42:26 user nova-compute[75409]: INFO nova.virt.block_device [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Booting with volume f36bd677-ec27-46cd-8d43-88c6d3265f09 at /dev/vda
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.utils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a300122-9c1f-4000-8ccd-de65303d28cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c94153-1bb1-44f4-9780-e20625e15db9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e700c-fcc2-4e80-b2a7-671f447c26e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c944c90-7d44-478a-926a-abc9a5430b7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:42:26 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:42:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86fd673-3f09-454c-a234-8aad4c344d12]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG os_brick.utils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:42:26 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updating existing volume attachment record: 418fca92-9584-4560-a9f4-b27da3d09abb {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Successfully created port: ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Successfully updated port: ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-changed-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Refreshing instance network info cache due to event network-changed-ea02c839-056c-4853-a067-9308203a5349. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] Acquiring lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updating instance_info_cache with network_info: [{"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Instance network_info: |[{"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] Acquired lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:27 user nova-compute[75409]: DEBUG nova.network.neutron [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Refreshing network info cache for port ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:42:28 user nova-compute[75409]: DEBUG nova.network.neutron [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updated VIF entry in instance network info cache for port ea02c839-056c-4853-a067-9308203a5349. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:42:28 user nova-compute[75409]: DEBUG nova.network.neutron [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updating instance_info_cache with network_info: [{"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-45dbebf8-f91a-43c1-ba0e-e5be5e24e600 req-77ff1f30-7c9d-4f9f-aad3-f201cb15fecf service nova] Releasing lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:42:31 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Creating image(s)
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Ensure instance console log exists: /opt/stack/data/nova/instances/1289c06a-49b2-443e-8b08-827619529dcf/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Start _get_guest_xml network_info=[{"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1289c06a-49b2-443e-8b08-827619529dcf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f36bd677-ec27-46cd-8d43-88c6d3265f09', 'serial': 'f36bd677-ec27-46cd-8d43-88c6d3265f09'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '418fca92-9584-4560-a9f4-b27da3d09abb', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:42:31 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:31 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:42:31 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:31 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:31 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ce20e-c940-4bf7-adc0-00d56121f75b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:42:31 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a68fd4-5d77-4e22-bfb3-8fb6a922eb93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09] added
Nov 15 21:42:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a0c07-2ca7-41a9-8114-9a8fee15e432]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa23d2-06b0-4820-8fc7-609f29414d10]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOKYVCjP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOKYVCjP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[003811e5-c5c0-4ee9-bbd0-efa35fec5fe0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOKYVCjP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa228b-7204-44e6-9e9d-cea6647e8a42]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd9994e-abb1-438f-ae03-67bf6064dac3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:31 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:31 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:31 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:31 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eb9b0d-2557-428e-b139-3c633e74ac57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]
Nov 15 21:42:31 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.
Nov 15 21:42:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee11eea7-9fc9-4b0a-9e09-6ec56df9cbfd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4407783e-c916-4d97-9039-3f05a3202b49]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:32 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:32 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cee4386-de67-4dd0-bd2c-9c421f14ad41]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:42:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26431616433633036', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431616433633036', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-936041839',display_name='tempest-TestVolumeBootPattern-server-936041839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-936041839',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0kj2v2tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:42:26Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=1289c06a-49b2-443e-8b08-827619529dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.objects.instance [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid 1289c06a-49b2-443e-8b08-827619529dcf {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:42:33 user nova-compute[75409]:   <uuid>1289c06a-49b2-443e-8b08-827619529dcf</uuid>
Nov 15 21:42:33 user nova-compute[75409]:   <name>instance-00000024</name>
Nov 15 21:42:33 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:42:33 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:42:33 user nova-compute[75409]:   <metadata>
Nov 15 21:42:33 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:42:33 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:42:33 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-server-936041839</nova:name>
Nov 15 21:42:33 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:42:31</nova:creationTime>
Nov 15 21:42:33 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:42:33 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:42:33 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:42:33 user nova-compute[75409]:       <nova:owner>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:42:33 user nova-compute[75409]:       </nova:owner>
Nov 15 21:42:33 user nova-compute[75409]:       <nova:ports>
Nov 15 21:42:33 user nova-compute[75409]:         <nova:port uuid="ea02c839-056c-4853-a067-9308203a5349">
Nov 15 21:42:33 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 21:42:33 user nova-compute[75409]:         </nova:port>
Nov 15 21:42:33 user nova-compute[75409]:       </nova:ports>
Nov 15 21:42:33 user nova-compute[75409]:     </nova:instance>
Nov 15 21:42:33 user nova-compute[75409]:   </metadata>
Nov 15 21:42:33 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:42:33 user nova-compute[75409]:     <system>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="serial">1289c06a-49b2-443e-8b08-827619529dcf</entry>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="uuid">1289c06a-49b2-443e-8b08-827619529dcf</entry>
Nov 15 21:42:33 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:42:33 user nova-compute[75409]:     </system>
Nov 15 21:42:33 user nova-compute[75409]:   </sysinfo>
Nov 15 21:42:33 user nova-compute[75409]:   <os>
Nov 15 21:42:33 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:42:33 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:42:33 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:42:33 user nova-compute[75409]:   </os>
Nov 15 21:42:33 user nova-compute[75409]:   <features>
Nov 15 21:42:33 user nova-compute[75409]:     <acpi/>
Nov 15 21:42:33 user nova-compute[75409]:     <apic/>
Nov 15 21:42:33 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:42:33 user nova-compute[75409]:   </features>
Nov 15 21:42:33 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:42:33 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:42:33 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:42:33 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:42:33 user nova-compute[75409]:   </clock>
Nov 15 21:42:33 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:42:33 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:42:33 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:42:33 user nova-compute[75409]:   </cpu>
Nov 15 21:42:33 user nova-compute[75409]:   <devices>
Nov 15 21:42:33 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:42:33 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:42:33 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:42:33 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:42:33 user nova-compute[75409]:       <serial>f36bd677-ec27-46cd-8d43-88c6d3265f09</serial>
Nov 15 21:42:33 user nova-compute[75409]:     </disk>
Nov 15 21:42:33 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:42:33 user nova-compute[75409]:       <mac address="fa:16:3e:6b:f6:6c"/>
Nov 15 21:42:33 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:42:33 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:42:33 user nova-compute[75409]:       <target dev="tapea02c839-05"/>
Nov 15 21:42:33 user nova-compute[75409]:     </interface>
Nov 15 21:42:33 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:42:33 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/1289c06a-49b2-443e-8b08-827619529dcf/console.log" append="off"/>
Nov 15 21:42:33 user nova-compute[75409]:     </serial>
Nov 15 21:42:33 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:42:33 user nova-compute[75409]:     <video>
Nov 15 21:42:33 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:42:33 user nova-compute[75409]:     </video>
Nov 15 21:42:33 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:42:33 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:42:33 user nova-compute[75409]:     </rng>
Nov 15 21:42:33 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:42:33 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:42:33 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:42:33 user nova-compute[75409]:     </memballoon>
Nov 15 21:42:33 user nova-compute[75409]:   </devices>
Nov 15 21:42:33 user nova-compute[75409]: </domain>
Nov 15 21:42:33 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-936041839',display_name='tempest-TestVolumeBootPattern-server-936041839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-936041839',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0kj2v2tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:42:26Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=1289c06a-49b2-443e-8b08-827619529dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG os_vif [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a751621c-3bac-5f49-8b54-a206dce01be2', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea02c839-05, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea02c839-05, col_values=(('qos', UUID('1ee700df-3fa2-4b65-81c4-f73949c3edc2')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea02c839-05, col_values=(('external_ids', {'iface-id': 'ea02c839-056c-4853-a067-9308203a5349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f6:6c', 'vm-uuid': '1289c06a-49b2-443e-8b08-827619529dcf'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:33 user nova-compute[75409]: INFO os_vif [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05')
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:42:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:6b:f6:6c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] No waiting events found dispatching network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:34 user nova-compute[75409]: WARNING nova.compute.manager [req-a2926c18-0a67-48ba-8f05-891368689c27 req-aa2df069-1fd3-4266-b27e-e628cad7a911 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received unexpected event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 for instance with vm_state building and task_state spawning.
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:42:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Instance spawned successfully.
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:42:36 user nova-compute[75409]: INFO nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] No waiting events found dispatching network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:36 user nova-compute[75409]: WARNING nova.compute.manager [req-35ce7b57-0115-4a1a-990e-991e9595f498 req-0426df63-ec47-4990-ab69-166e04c0db3c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received unexpected event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 for instance with vm_state building and task_state spawning.
Nov 15 21:42:36 user nova-compute[75409]: INFO nova.compute.manager [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Took 10.73 seconds to build instance.
Nov 15 21:42:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-96db52dc-74c5-4259-ba91-2acaa83906e0 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.835s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG nova.network.neutron [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'info_cache' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:46 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance destroyed successfully.
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'resources' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c482854-d2, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62fd0228-2aaf-4d0e-9de5-4ef2577f6b24) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:47 user nova-compute[75409]: INFO os_vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:42:47 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d697dd-7c7c-4d53-bd41-806c4cfc80f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:42:47 user nova-compute[75409]: No targets found.
Nov 15 21:42:47 user nova-compute[75409]: iSNS:
Nov 15 21:42:47 user nova-compute[75409]: No targets found.
Nov 15 21:42:47 user nova-compute[75409]: STATIC:
Nov 15 21:42:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:42:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:42:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:42:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:42:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:47 user nova-compute[75409]: FIRMWARE:
Nov 15 21:42:47 user nova-compute[75409]: No targets found.
Nov 15 21:42:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:42:47 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:42:47 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c0e64-d2df-460b-947f-053b0fcd29ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc56e4-2334-4e8e-97f9-57b8e4befdfd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:47 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf284dedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b9997-17b1-4bac-bb4d-989770dbdeea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78e92f-ba30-46f2-9cc6-404f7c1ae046]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8144a9-33ad-4382-811d-bcf3107cc437]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.211s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fbd88-c0c6-4fed-8974-f35e2f22222a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a030b0-2615-498c-8879-c549e2c08006]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61cc6c1-2403-44aa-b68a-a2c217b8f032]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]
Nov 15 21:42:47 user nova-compute[75409]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.
Nov 15 21:42:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7feee7-399f-4f6e-9d63-f2fa8ffc2cf6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.552s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== disconnect_volume: return (552ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start _get_guest_xml network_info=[{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f3c2a748-56e5-49bb-bc58-a0fb96706fda', 'attached_at': '', 'detached_at': '', 'volume_id': '11793d7a-934c-4cef-8653-56509884bff3', 'serial': '11793d7a-934c-4cef-8653-56509884bff3'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '503e7282-8fa4-4634-86e6-56e6ea552a1b', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'numa_topology' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:42:47 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:47 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:47 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa54554-df46-4356-919b-806bf8c666e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:42:47 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e9138a-23ef-4bc6-b38f-90f50f8d947e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3] added
Nov 15 21:42:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6cc23f-7399-4a8c-b0b1-f0581a2722ef]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42b49f-1bad-49b0-845b-ebfd43a602a6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfbMDqB {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfbMDqB" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2fbe2d-727b-498a-9f43-a5bc3ad1ece0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXfbMDqB'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7802f3a-ce56-4d84-b61a-72130a1d56ea]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c6df10-f27a-49af-b931-b9a64d7001f1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ad4b8-d4e7-45a1-8dba-abed68b7d9a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]
Nov 15 21:42:48 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.
Nov 15 21:42:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff91d29-47a8-4fe7-84ef-2b4c4928ecf3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a755124-e025-4e29-87a6-8bb77d061c04]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c027961e-45ab-4197-ac38-60067e478d10]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26262376430366335', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262376430366335', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:42:49 user nova-compute[75409]:   <uuid>f3c2a748-56e5-49bb-bc58-a0fb96706fda</uuid>
Nov 15 21:42:49 user nova-compute[75409]:   <name>instance-00000021</name>
Nov 15 21:42:49 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:42:49 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:42:49 user nova-compute[75409]:   <metadata>
Nov 15 21:42:49 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:42:49 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeTestJSON-server-1716788624</nova:name>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:42:47</nova:creationTime>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:42:49 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:42:49 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:owner>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:user uuid="e867fa9de5b345518d1e7bea923f8e55">tempest-AttachVolumeTestJSON-753726309-project-member</nova:user>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:project uuid="fbce891b648d4fa299edae25edf1965a">tempest-AttachVolumeTestJSON-753726309</nova:project>
Nov 15 21:42:49 user nova-compute[75409]:       </nova:owner>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:42:49 user nova-compute[75409]:       <nova:ports>
Nov 15 21:42:49 user nova-compute[75409]:         <nova:port uuid="9c482854-d245-4c9e-8092-5e046c8ea6b2">
Nov 15 21:42:49 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:42:49 user nova-compute[75409]:         </nova:port>
Nov 15 21:42:49 user nova-compute[75409]:       </nova:ports>
Nov 15 21:42:49 user nova-compute[75409]:     </nova:instance>
Nov 15 21:42:49 user nova-compute[75409]:   </metadata>
Nov 15 21:42:49 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:42:49 user nova-compute[75409]:     <system>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="serial">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="uuid">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:42:49 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:42:49 user nova-compute[75409]:     </system>
Nov 15 21:42:49 user nova-compute[75409]:   </sysinfo>
Nov 15 21:42:49 user nova-compute[75409]:   <os>
Nov 15 21:42:49 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:42:49 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:42:49 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:42:49 user nova-compute[75409]:   </os>
Nov 15 21:42:49 user nova-compute[75409]:   <features>
Nov 15 21:42:49 user nova-compute[75409]:     <acpi/>
Nov 15 21:42:49 user nova-compute[75409]:     <apic/>
Nov 15 21:42:49 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:42:49 user nova-compute[75409]:   </features>
Nov 15 21:42:49 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:42:49 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:42:49 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:42:49 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:42:49 user nova-compute[75409]:   </clock>
Nov 15 21:42:49 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:42:49 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:42:49 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:42:49 user nova-compute[75409]:   </cpu>
Nov 15 21:42:49 user nova-compute[75409]:   <devices>
Nov 15 21:42:49 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:42:49 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:42:49 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk"/>
Nov 15 21:42:49 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:42:49 user nova-compute[75409]:     </disk>
Nov 15 21:42:49 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:42:49 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:42:49 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:42:49 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:42:49 user nova-compute[75409]:       <serial>11793d7a-934c-4cef-8653-56509884bff3</serial>
Nov 15 21:42:49 user nova-compute[75409]:     </disk>
Nov 15 21:42:49 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:42:49 user nova-compute[75409]:       <mac address="fa:16:3e:e7:6a:61"/>
Nov 15 21:42:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:42:49 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:42:49 user nova-compute[75409]:       <target dev="tap9c482854-d2"/>
Nov 15 21:42:49 user nova-compute[75409]:     </interface>
Nov 15 21:42:49 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:42:49 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/console.log" append="off"/>
Nov 15 21:42:49 user nova-compute[75409]:     </serial>
Nov 15 21:42:49 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:42:49 user nova-compute[75409]:     <video>
Nov 15 21:42:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:42:49 user nova-compute[75409]:     </video>
Nov 15 21:42:49 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:42:49 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:42:49 user nova-compute[75409]:     </rng>
Nov 15 21:42:49 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:42:49 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:42:49 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:42:49 user nova-compute[75409]:     </memballoon>
Nov 15 21:42:49 user nova-compute[75409]:   </devices>
Nov 15 21:42:49 user nova-compute[75409]: </domain>
Nov 15 21:42:49 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'migration_context' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.objects.base [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG os_vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c976385a-d566-5cea-a715-286d16b4be5f', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c482854-d2, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c482854-d2, col_values=(('qos', UUID('6b8674a3-a2a2-4fda-96f2-aa36986fb48b')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c482854-d2, col_values=(('external_ids', {'iface-id': '9c482854-d245-4c9e-8092-5e046c8ea6b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6a:61', 'vm-uuid': 'f3c2a748-56e5-49bb-bc58-a0fb96706fda'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:49 user nova-compute[75409]: INFO os_vif [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:42:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:51 user nova-compute[75409]: WARNING nova.compute.manager [req-2dd1d89e-fa4b-4094-9659-e0eb3b5561b2 req-2dc4f5ed-e0c0-44c5-b6fc-b7bd4e254931 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state powering-on.
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:42:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing instance network info cache due to event network-changed-78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] Acquiring lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] Acquired lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.network.neutron [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Refreshing network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:53 user nova-compute[75409]: INFO nova.compute.manager [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Terminating instance
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:42:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance rebooted successfully.
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-730c9c86-7f3d-497c-9c30-e6f6b222a340 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:53 user nova-compute[75409]: WARNING nova.compute.manager [req-6bf122fd-6e63-4f54-9985-a7ff29d77802 req-cfd1e813-28fd-4f7d-8b44-0befbdc59128 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state powering-on.
Nov 15 21:42:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updated VIF entry in instance network info cache for port 78a30fb2-9596-40d3-babb-d53e874d7f95. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [{"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ebcc1ab0-259d-401c-8075-2d3a26a45c27 req-f86240fe-f9a5-4db6-a82e-ebd45ea44526 service nova] Releasing lock "refresh_cache-e76992cb-1288-4d56-b821-10232ba24eb9" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8049MB free_disk=25.161800384521484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Instance destroyed successfully.
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lazy-loading 'resources' on Instance uuid e76992cb-1288-4d56-b821-10232ba24eb9 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2099334093',display_name='tempest-TestShelveInstance-server-2099334093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2099334093',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT+V+solto7CW75MJneGFUQj+CHR8ovATiaLIQZ3t99se9MgA/t8ZQ6Ap6SfN9VNZkLNJHya6NApaIZF/KlS6tyWYZgqJWLSjE3+a9pe7Mwl1peyiIhqi0nm912lK5KTQ==',key_name='tempest-TestShelveInstance-1229559182',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2379b1b186a54fac907d4e4f270f1bdc',ramdisk_id='',reservation_id='r-jlcob02o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-67678213',owner_user_name='tempest-TestShelveInstance-67678213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:41:15Z,user_data=None,user_id='61b68c1d5a1f42f09cfe7ba3b860d40d',uuid=e76992cb-1288-4d56-b821-10232ba24eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converting VIF {"id": "78a30fb2-9596-40d3-babb-d53e874d7f95", "address": "fa:16:3e:45:1f:ae", "network": {"id": "fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1375195843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2379b1b186a54fac907d4e4f270f1bdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78a30fb2-95", "ovs_interfaceid": "78a30fb2-9596-40d3-babb-d53e874d7f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_vif [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78a30fb2-95, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87997c9b-2c87-4bf8-ba02-fe8bdacfb595) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: INFO os_vif [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:1f:ae,bridge_name='br-int',has_traffic_filtering=True,id=78a30fb2-9596-40d3-babb-d53e874d7f95,network=Network(fb58de0b-f6b2-46f6-bcbd-a3c98f59ed9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78a30fb2-95')
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPCnedoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:42:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03928f7-2284-4c6a-86c6-1bb9496d801f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:42:54 user nova-compute[75409]: No targets found.
Nov 15 21:42:54 user nova-compute[75409]: iSNS:
Nov 15 21:42:54 user nova-compute[75409]: No targets found.
Nov 15 21:42:54 user nova-compute[75409]: STATIC:
Nov 15 21:42:54 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:42:54 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:54 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:54 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:42:54 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:54 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:54 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20
Nov 15 21:42:54 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:54 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:54 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:42:54 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:42:54 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:42:54 user nova-compute[75409]: FIRMWARE:
Nov 15 21:42:54 user nova-compute[75409]: No targets found.
Nov 15 21:42:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:42:54 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:42:54 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a5ec9-fb22-4d0a-be37-53d6c879bb3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e76992cb-1288-4d56-b821-10232ba24eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 1289c06a-49b2-443e-8b08-827619529dcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31afb28c-23d2-4dde-9cf7-278cea3f6779]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:54 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:54 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:54 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 (non-flash)
Nov 15 21:42:55 user nova-compute[75409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:42:55 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:42:55 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:42:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281e25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d7b5b-59ae-4bfb-8dcd-ad2d30058e73]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[19737c67-0406-47c4-af75-b848d8966324]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb7b2c-8b18-42ec-97a6-2a70fa4311c1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d9563-f475-4a19-a1ab-e6328b2466c9]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[662257fe-df84-40a0-9f76-1ca1c438a63d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cd6dc9-ebaa-41ab-a5e6-908ebde37f75]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260]
Nov 15 21:42:55 user nova-compute[75409]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20, portal: 172.16.0.220,3260] successful.
Nov 15 21:42:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8601d547-ec5f-4cbc-b7dc-0e6c41655f20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc864d-c18c-4445-bdf7-669a71802d40]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.643s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] <== disconnect_volume: return (644ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:42:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deleting instance files /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9_del
Nov 15 21:42:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deletion of /opt/stack/data/nova/instances/e76992cb-1288-4d56-b821-10232ba24eb9_del complete
Nov 15 21:42:55 user nova-compute[75409]: INFO nova.compute.manager [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Took 1.90 seconds to destroy the instance on the hypervisor.
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-unplugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Acquiring lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] Lock "e76992cb-1288-4d56-b821-10232ba24eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] No waiting events found dispatching network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:42:55 user nova-compute[75409]: WARNING nova.compute.manager [req-88f2a406-d09a-46cb-993b-d06d5c5ad773 req-0d9df4f8-cceb-4984-9456-5443d2264116 service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received unexpected event network-vif-plugged-78a30fb2-9596-40d3-babb-d53e874d7f95 for instance with vm_state active and task_state deleting.
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:55 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Took 0.40 seconds to deallocate network for instance.
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-91d6099a-aa2c-43d4-b694-4dc27b449a20 req-bc835715-8337-4534-beca-c497f5d8620c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Received event network-vif-deleted-78a30fb2-9596-40d3-babb-d53e874d7f95 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:55 user nova-compute[75409]: INFO nova.compute.manager [req-91d6099a-aa2c-43d4-b694-4dc27b449a20 req-bc835715-8337-4534-beca-c497f5d8620c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Neutron deleted interface 78a30fb2-9596-40d3-babb-d53e874d7f95; detaching it from the instance and deleting it from the info cache
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.network.neutron [req-91d6099a-aa2c-43d4-b694-4dc27b449a20 req-bc835715-8337-4534-beca-c497f5d8620c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-91d6099a-aa2c-43d4-b694-4dc27b449a20 req-bc835715-8337-4534-beca-c497f5d8620c service nova] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Detach interface failed, port_id=78a30fb2-9596-40d3-babb-d53e874d7f95, reason: Instance e76992cb-1288-4d56-b821-10232ba24eb9 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Skipping network cache update for instance because it is being deleted. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:42:56 user nova-compute[75409]: INFO nova.compute.manager [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] [instance: e76992cb-1288-4d56-b821-10232ba24eb9] Deleting volume: 8601d547-ec5f-4cbc-b7dc-0e6c41655f20 {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:42:56 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:42:57 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Deleted allocations for instance e76992cb-1288-4d56-b821-10232ba24eb9
Nov 15 21:42:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:42:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1190096a-bc42-4bd5-a68d-84c62d2bf5d7 tempest-TestShelveInstance-67678213 tempest-TestShelveInstance-67678213-project-member] Lock "e76992cb-1288-4d56-b821-10232ba24eb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.695s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:42:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:42:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing instance network info cache due to event network-changed-3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:42:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] Acquiring lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:42:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] Acquired lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:42:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Refreshing network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:42:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updated VIF entry in instance network info cache for port 3a5939fb-e818-4bad-92ee-ab635a88cff8. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:42:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [{"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:42:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5141f6b0-82c9-4824-93be-31c51e3259c1 req-a9cd86c3-74fb-4e8d-963b-567636c2dd09 service nova] Releasing lock "refresh_cache-8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:42:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:42:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Stashing vm_state: active {{(pid=75409) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:43:00 user nova-compute[75409]: INFO nova.compute.claims [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Claim successful on node user
Nov 15 21:43:00 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating resource usage from migration 51547f93-06b8-43d6-85b6-366e73bcea66
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.315s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:00 user nova-compute[75409]: INFO nova.compute.manager [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Migrating
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-changed-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Refreshing instance network info cache due to event network-changed-0dcbe4d7-e100-44f5-97f6-a299379d2246. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:43:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Refreshing network info cache for port 0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Starting migrate_disk_and_power_off {{(pid=75409) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updated VIF entry in instance network info cache for port 0dcbe4d7-e100-44f5-97f6-a299379d2246. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:43:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c34dfe6-ff05-4686-8e49-9c14a673e713 req-34b765d8-ec10-4b50-8a14-2ddbbcdbe14a service nova] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:02 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance destroyed successfully.
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcbe4d7-e1, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=371f7ab0-4469-4e93-a234-5c48ef29b239) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:02 user nova-compute[75409]: INFO os_vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1')
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:43:02 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede3776-d7f0-4d1d-8064-26e4b7a77ec5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:43:02 user nova-compute[75409]: No targets found.
Nov 15 21:43:02 user nova-compute[75409]: iSNS:
Nov 15 21:43:02 user nova-compute[75409]: No targets found.
Nov 15 21:43:02 user nova-compute[75409]: STATIC:
Nov 15 21:43:02 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:43:02 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:43:02 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:43:02 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:43:02 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:43:02 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:43:02 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:43:02 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:43:02 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:43:02 user nova-compute[75409]: FIRMWARE:
Nov 15 21:43:02 user nova-compute[75409]: No targets found.
Nov 15 21:43:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:43:02 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:43:02 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47d6cab-b86c-4a3a-b242-bb29f59e0701]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d014c-9174-4bc6-b0c4-84047eaee240]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:02 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:02 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:02 user nova-compute[75409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:02 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087279a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b'): ({'sdf'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Removing single pathed devices sdf {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:02 user nova-compute[75409]: WARNING nova.compute.manager [req-7c5d4439-cc27-436e-b1c8-8ae8ffae9e12 req-afd53b79-394d-40d1-8b4c-26967607831f service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state active and task_state resize_migrating.
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abcd920-6fc7-43b9-a1aa-e33a9c2281ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[971e89a7-f963-4795-beeb-78dc0842045d]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flushing IO for device /dev/sdf {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a2c7c-a48a-4edd-bed5-87035840764b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979c0f9-bb3d-4773-a1da-fb60fbb54335]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] SCSI volumes sdf have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1177117-a83c-44cd-83de-d85d84b93277]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e25558-973d-4685-b362-8df7fb7820d6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]
Nov 15 21:43:02 user nova-compute[75409]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.
Nov 15 21:43:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e0a380-3497-4269-907b-cfa8bff61d44]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== disconnect_volume: return (327ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:43:02 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Port 0dcbe4d7-e100-44f5-97f6-a299379d2246 binding to destination host user is already ACTIVE {{(pid=75409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:04 user nova-compute[75409]: WARNING nova.compute.manager [req-0607acfc-1243-485a-9f27-837fd1af080e req-317d4e7e-c005-4ef6-9218-e2021b61ab64 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state active and task_state resize_migrated.
Nov 15 21:43:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c07729-e3b6-4029-a73c-8164028df12e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de77b2-656a-4a6a-a9b5-17b58ce4511a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e56303-2431-45d9-a09b-f2cd76d7c40d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b4d01-6d4b-4137-b772-e1e82690d363]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:43:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:43:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0cf1aa-36e4-4285-9aaf-eb019014fa06]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:43:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Starting finish_migration {{(pid=75409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:43:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Creating image(s)
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Ensure instance console log exists: /opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start _get_guest_xml network_info=[{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '07498a3f-f560-46db-9ac2-f466c7080d9c', 'attached_at': '2023-11-15T21:43:09.000000', 'detached_at': '', 'volume_id': '9feba7af-9dc3-4715-a55b-0ae384ab891b', 'serial': '9feba7af-9dc3-4715-a55b-0ae384ab891b'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'dae93747-d317-4639-ab9d-3b360d7e2953', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:43:09 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:09 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:43:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:43:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:43:09 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9712580-824a-494c-9c85-83608a9d96c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:43:09 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[127a9ade-ea99-48e2-862d-61ec86e52a04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b] added
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5858fb20-0f82-41cb-acd5-74aebba2ac0e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8d38c-f406-4220-aca5-45ed448d0bd9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trwBEcju {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trwBEcju" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4acfab2-a869-4a54-be44-b50e13a77c5e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'trwBEcju'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e0b605-9944-444e-a305-f70be84ce388]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b92d1-abb4-43af-b0e7-39d9c52a2c41]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d0abe-7851-44ae-af68-c83718a88df0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]
Nov 15 21:43:09 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423b50c-fa89-4e27-a935-abe89fd47feb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8c918-f4b6-467d-b2a0-605fac12cf5f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:09 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84fc917-aa65-4f1c-becc-0f1dfeb16c82]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:43:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23361363832386165', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361363832386165', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:43:10 user nova-compute[75409]:   <uuid>07498a3f-f560-46db-9ac2-f466c7080d9c</uuid>
Nov 15 21:43:10 user nova-compute[75409]:   <name>instance-00000022</name>
Nov 15 21:43:10 user nova-compute[75409]:   <memory>2097152</memory>
Nov 15 21:43:10 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:43:10 user nova-compute[75409]:   <metadata>
Nov 15 21:43:10 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:43:10 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:43:10 user nova-compute[75409]:       <nova:name>tempest-ServerActionsTestOtherA-server-1004802004</nova:name>
Nov 15 21:43:10 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:43:09</nova:creationTime>
Nov 15 21:43:10 user nova-compute[75409]:       <nova:flavor name="m1.small">
Nov 15 21:43:10 user nova-compute[75409]:         <nova:memory>2048</nova:memory>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:disk>20</nova:disk>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:43:10 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:43:10 user nova-compute[75409]:       <nova:owner>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:user uuid="4ae40e5bccb84c50a4c93963d56469f9">tempest-ServerActionsTestOtherA-1526007087-project-member</nova:user>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:project uuid="a8d130f253b745e2ac2497eebbd4cf99">tempest-ServerActionsTestOtherA-1526007087</nova:project>
Nov 15 21:43:10 user nova-compute[75409]:       </nova:owner>
Nov 15 21:43:10 user nova-compute[75409]:       <nova:ports>
Nov 15 21:43:10 user nova-compute[75409]:         <nova:port uuid="0dcbe4d7-e100-44f5-97f6-a299379d2246">
Nov 15 21:43:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 21:43:10 user nova-compute[75409]:         </nova:port>
Nov 15 21:43:10 user nova-compute[75409]:       </nova:ports>
Nov 15 21:43:10 user nova-compute[75409]:     </nova:instance>
Nov 15 21:43:10 user nova-compute[75409]:   </metadata>
Nov 15 21:43:10 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:43:10 user nova-compute[75409]:     <system>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="serial">07498a3f-f560-46db-9ac2-f466c7080d9c</entry>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="uuid">07498a3f-f560-46db-9ac2-f466c7080d9c</entry>
Nov 15 21:43:10 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:43:10 user nova-compute[75409]:     </system>
Nov 15 21:43:10 user nova-compute[75409]:   </sysinfo>
Nov 15 21:43:10 user nova-compute[75409]:   <os>
Nov 15 21:43:10 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:43:10 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:43:10 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:43:10 user nova-compute[75409]:   </os>
Nov 15 21:43:10 user nova-compute[75409]:   <features>
Nov 15 21:43:10 user nova-compute[75409]:     <acpi/>
Nov 15 21:43:10 user nova-compute[75409]:     <apic/>
Nov 15 21:43:10 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:43:10 user nova-compute[75409]:   </features>
Nov 15 21:43:10 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:43:10 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:43:10 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:43:10 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:43:10 user nova-compute[75409]:   </clock>
Nov 15 21:43:10 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:43:10 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:43:10 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:43:10 user nova-compute[75409]:   </cpu>
Nov 15 21:43:10 user nova-compute[75409]:   <devices>
Nov 15 21:43:10 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:43:10 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:43:10 user nova-compute[75409]:       <source dev="/dev/sdd"/>
Nov 15 21:43:10 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:43:10 user nova-compute[75409]:       <serial>9feba7af-9dc3-4715-a55b-0ae384ab891b</serial>
Nov 15 21:43:10 user nova-compute[75409]:     </disk>
Nov 15 21:43:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:43:10 user nova-compute[75409]:       <mac address="fa:16:3e:15:57:32"/>
Nov 15 21:43:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:43:10 user nova-compute[75409]:       <target dev="tap0dcbe4d7-e1"/>
Nov 15 21:43:10 user nova-compute[75409]:     </interface>
Nov 15 21:43:10 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:43:10 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c/console.log" append="off"/>
Nov 15 21:43:10 user nova-compute[75409]:     </serial>
Nov 15 21:43:10 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:43:10 user nova-compute[75409]:     <video>
Nov 15 21:43:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:10 user nova-compute[75409]:     </video>
Nov 15 21:43:10 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:43:10 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:43:10 user nova-compute[75409]:     </rng>
Nov 15 21:43:10 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:43:10 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:43:10 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:43:10 user nova-compute[75409]:     </memballoon>
Nov 15 21:43:10 user nova-compute[75409]:   </devices>
Nov 15 21:43:10 user nova-compute[75409]: </domain>
Nov 15 21:43:10 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1828257159-network", "vif_mac": "fa:16:3e:15:57:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG os_vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a893deba-7e97-5f8b-b7dd-0e3dcca7ca7e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcbe4d7-e1, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dcbe4d7-e1, col_values=(('qos', UUID('7081e63b-4672-46d3-91a9-d27eaa555249')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dcbe4d7-e1, col_values=(('external_ids', {'iface-id': '0dcbe4d7-e100-44f5-97f6-a299379d2246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:57:32', 'vm-uuid': '07498a3f-f560-46db-9ac2-f466c7080d9c'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:10 user nova-compute[75409]: INFO os_vif [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1')
Nov 15 21:43:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:43:10 user nova-compute[75409]: INFO nova.compute.claims [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Claim successful on node user
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] No VIF found with MAC fa:16:3e:15:57:32, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:43:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.policy [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752b5dc398bb45608817b61c4ccbfb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d9e1e2556e4ec396ccabb7f7126bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:43:11 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Creating image(s)
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "/opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk 1073741824" returned: 0 in 0.050s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Successfully created port: 51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Cannot resize image /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Ensure instance console log exists: /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:12 user nova-compute[75409]: DEBUG nova.compute.manager [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:12 user nova-compute[75409]: WARNING nova.compute.manager [req-26d8ea63-e3f3-4703-b994-fe8b6c4015ec req-eb1a47d7-b907-49a1-8059-44b782e8a5c1 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state active and task_state resize_finish.
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Successfully updated port: 51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquired lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updating instance_info_cache with network_info: [{"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Releasing lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Instance network_info: |[{"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Start _get_guest_xml network_info=[{"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:43:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478638340',display_name='tempest-AttachVolumeNegativeTest-server-478638340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478638340',id=37,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0bsCJUlMvUsOB+JTj/Cc/7BwH9MQcesIHrwXAUBwipxPOOqwRPSHnTvFWEAjMqXuiRtlbwvnc40N9xlovbf7LZ047oLMKwnlfe90yLXBQk1PDDiVhx4z/n2SmHIDjp9g==',key_name='tempest-keypair-1681312184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-ybhxepk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=2faf4b51-8c78-4790-ad56-881663ac93f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'pci_devices' on Instance uuid 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:43:13 user nova-compute[75409]:   <uuid>2faf4b51-8c78-4790-ad56-881663ac93f4</uuid>
Nov 15 21:43:13 user nova-compute[75409]:   <name>instance-00000025</name>
Nov 15 21:43:13 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:43:13 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:43:13 user nova-compute[75409]:   <metadata>
Nov 15 21:43:13 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:43:13 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-478638340</nova:name>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:43:13</nova:creationTime>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:43:13 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:43:13 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:owner>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:user uuid="752b5dc398bb45608817b61c4ccbfb8b">tempest-AttachVolumeNegativeTest-1984244406-project-member</nova:user>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:project uuid="45d9e1e2556e4ec396ccabb7f7126bf0">tempest-AttachVolumeNegativeTest-1984244406</nova:project>
Nov 15 21:43:13 user nova-compute[75409]:       </nova:owner>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:43:13 user nova-compute[75409]:       <nova:ports>
Nov 15 21:43:13 user nova-compute[75409]:         <nova:port uuid="51967499-9898-4f65-8f19-40dd83d431f0">
Nov 15 21:43:13 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:43:13 user nova-compute[75409]:         </nova:port>
Nov 15 21:43:13 user nova-compute[75409]:       </nova:ports>
Nov 15 21:43:13 user nova-compute[75409]:     </nova:instance>
Nov 15 21:43:13 user nova-compute[75409]:   </metadata>
Nov 15 21:43:13 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:43:13 user nova-compute[75409]:     <system>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="serial">2faf4b51-8c78-4790-ad56-881663ac93f4</entry>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="uuid">2faf4b51-8c78-4790-ad56-881663ac93f4</entry>
Nov 15 21:43:13 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:43:13 user nova-compute[75409]:     </system>
Nov 15 21:43:13 user nova-compute[75409]:   </sysinfo>
Nov 15 21:43:13 user nova-compute[75409]:   <os>
Nov 15 21:43:13 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:43:13 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:43:13 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:43:13 user nova-compute[75409]:   </os>
Nov 15 21:43:13 user nova-compute[75409]:   <features>
Nov 15 21:43:13 user nova-compute[75409]:     <acpi/>
Nov 15 21:43:13 user nova-compute[75409]:     <apic/>
Nov 15 21:43:13 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:43:13 user nova-compute[75409]:   </features>
Nov 15 21:43:13 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:43:13 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:43:13 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:43:13 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:43:13 user nova-compute[75409]:   </clock>
Nov 15 21:43:13 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:43:13 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:43:13 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:43:13 user nova-compute[75409]:   </cpu>
Nov 15 21:43:13 user nova-compute[75409]:   <devices>
Nov 15 21:43:13 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:43:13 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:43:13 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk"/>
Nov 15 21:43:13 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:43:13 user nova-compute[75409]:     </disk>
Nov 15 21:43:13 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:43:13 user nova-compute[75409]:       <mac address="fa:16:3e:7a:1f:e2"/>
Nov 15 21:43:13 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:13 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:43:13 user nova-compute[75409]:       <target dev="tap51967499-98"/>
Nov 15 21:43:13 user nova-compute[75409]:     </interface>
Nov 15 21:43:13 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:43:13 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/console.log" append="off"/>
Nov 15 21:43:13 user nova-compute[75409]:     </serial>
Nov 15 21:43:13 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:43:13 user nova-compute[75409]:     <video>
Nov 15 21:43:13 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:13 user nova-compute[75409]:     </video>
Nov 15 21:43:13 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:43:13 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:43:13 user nova-compute[75409]:     </rng>
Nov 15 21:43:13 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:43:13 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:43:13 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:43:13 user nova-compute[75409]:     </memballoon>
Nov 15 21:43:13 user nova-compute[75409]:   </devices>
Nov 15 21:43:13 user nova-compute[75409]: </domain>
Nov 15 21:43:13 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478638340',display_name='tempest-AttachVolumeNegativeTest-server-478638340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478638340',id=37,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0bsCJUlMvUsOB+JTj/Cc/7BwH9MQcesIHrwXAUBwipxPOOqwRPSHnTvFWEAjMqXuiRtlbwvnc40N9xlovbf7LZ047oLMKwnlfe90yLXBQk1PDDiVhx4z/n2SmHIDjp9g==',key_name='tempest-keypair-1681312184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-ybhxepk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:43:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=2faf4b51-8c78-4790-ad56-881663ac93f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG os_vif [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df2390c4-7990-5e44-a5b4-b38e2e4cdf49', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51967499-98, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51967499-98, col_values=(('qos', UUID('6b9056fc-8187-4fcb-a5e0-d856c7ed36e4')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51967499-98, col_values=(('external_ids', {'iface-id': '51967499-9898-4f65-8f19-40dd83d431f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:1f:e2', 'vm-uuid': '2faf4b51-8c78-4790-ad56-881663ac93f4'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:13 user nova-compute[75409]: INFO os_vif [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98')
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:7a:1f:e2, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:43:14 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance running successfully.
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Failed to set time: agent not configured {{(pid=75409) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4e54bff2-213e-4d98-9570-64601e1ed5db tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] finish_migration finished successfully. {{(pid=75409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:14 user nova-compute[75409]: WARNING nova.compute.manager [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state resized and task_state None.
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-changed-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Refreshing instance network info cache due to event network-changed-51967499-9898-4f65-8f19-40dd83d431f0. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Acquiring lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Acquired lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG nova.network.neutron [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Refreshing network info cache for port 51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updated VIF entry in instance network info cache for port 51967499-9898-4f65-8f19-40dd83d431f0. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG nova.network.neutron [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updating instance_info_cache with network_info: [{"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-71bb5622-0d15-42ae-9774-3c055d32a787 req-17631862-82b4-4f90-b0be-be032f0bb4a2 service nova] Releasing lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] No waiting events found dispatching network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:16 user nova-compute[75409]: WARNING nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received unexpected event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 for instance with vm_state building and task_state spawning.
Nov 15 21:43:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] No waiting events found dispatching network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:16 user nova-compute[75409]: WARNING nova.compute.manager [req-ee72197d-0b3c-49b4-8a5c-c442f2885fbd req-cab78319-0e9d-48d2-991c-44303a26117a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received unexpected event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 for instance with vm_state building and task_state spawning.
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:43:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Instance spawned successfully.
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:43:17 user nova-compute[75409]: INFO nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 15 21:43:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:43:17 user nova-compute[75409]: INFO nova.compute.manager [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Took 6.62 seconds to build instance.
Nov 15 21:43:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1c86b875-2d38-49e5-ada4-ee4a8365a78f tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-changed-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing instance network info cache due to event network-changed-d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG nova.network.neutron [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing network info cache for port d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'flavor' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG nova.network.neutron [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updated VIF entry in instance network info cache for port d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG nova.network.neutron [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d2e03367-f1b0-474d-b379-42da206a2af8 req-7e7580c5-f661-4e34-b2ca-b5f8256b82c4 service nova] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:26 user nova-compute[75409]: INFO nova.compute.manager [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Attaching volume 2d43b675-95c9-4d7c-8f91-5819030323e3 to /dev/vdb
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.utils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb37d793-58f4-4044-a579-a9e0d50d4fe4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80022786-c5b4-458d-aea5-9a74840e628d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60161bf8-7fc4-43a1-bef8-ce73d64fb8bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a342adf-cafe-4dcd-b53c-87b67b636248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:43:26 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:43:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[44abd572-0dfe-461c-a7c5-2be372ec30e6]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG os_brick.utils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:43:26 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating existing volume attachment record: f7466efd-77fc-402a-b55f-adcaa14008a1 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:43:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arkSqfNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:43:31 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:43:31 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:43:31 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9b4c6-aad7-4316-9a01-ed8655e2af48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:43:31 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ef248-b08b-4206-b3d2-626aa48a887d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3] added
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb515ae-9d66-43b5-a8b3-9a29bfcf6cbd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d4149-a7bd-4511-8e4f-6150888c1368]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arkSqfNC {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v arkSqfNC" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1906243e-c321-4e64-bfae-6ae914628030]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'arkSqfNC'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41781392-173f-401a-85e7-426d0383c090]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24349f0-5bb6-42f3-bcd0-b5dfcd114875]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91639edb-4ff5-41e5-b1c9-c33ab3eb603d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260]
Nov 15 21:43:31 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260] successful.
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[289628f8-e2b5-4a01-9263-45bdfc9e7b72]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468a957-ffa5-4ccc-b6f2-d5b48a046e7f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:43:31 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:43:31 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3524b08-9c5d-4acd-9212-1f9d031cf879]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:43:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arkSqfNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:43:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:43:32 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23332626562653839', 'path': '/dev/sde'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:43:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332626562653839', 'path': '/dev/sde'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:43:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'flavor' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:43:32 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:43:32 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:43:32 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:43:32 user nova-compute[75409]:   <serial>2d43b675-95c9-4d7c-8f91-5819030323e3</serial>
Nov 15 21:43:32 user nova-compute[75409]: </disk>
Nov 15 21:43:32 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:9e:b3:b8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2516c2e4-c83e-4ad2-a4a2-49da0932cf5e tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.113s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:33 user nova-compute[75409]: INFO nova.compute.manager [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Rescuing
Nov 15 21:43:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:33 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:34 user nova-compute[75409]: WARNING nova.compute.manager [req-e44a346d-8521-4e25-b9e3-cc9935472890 req-7f9f450c-b57f-4b0c-924d-a5da8d12c9dd service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state rescuing.
Nov 15 21:43:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance destroyed successfully.
Nov 15 21:43:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Attempting rescue
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:43:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Creating image(s)
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'trusted_certs' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue" returned: 0 in 0.063s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'migration_context' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.base [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<d69ede3d-9720-4345-8d76-28aa6d731e7d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start _get_guest_xml network_info=[{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:9e:b3:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.base [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<d69ede3d-9720-4345-8d76-28aa6d731e7d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'numa_topology' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.base [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<d69ede3d-9720-4345-8d76-28aa6d731e7d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:43:35 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:35 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'vcpu_model' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.base [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<d69ede3d-9720-4345-8d76-28aa6d731e7d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500346698',display_name='tempest-ServerRescueNegativeTestJSON-server-500346698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500346698',id=35,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESbsqe6k+BJfxjRCAjFpuLmFnEi5oy77GEeYOthZcY5F4vDxqfYdYv5F2l+z32Gs1Rc6yR9aVbYNQxfBQ5UlT814Q6EzsLAWsLmDF1wF0nIbqec0N/wfjWxiyss3cSKvw==',key_name='tempest-keypair-606468414',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:41:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-tptdfn53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=d69ede3d-9720-4345-8d76-28aa6d731e7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:9e:b3:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "vif_mac": "fa:16:3e:9e:b3:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'pci_devices' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.objects.base [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Object Instance<d69ede3d-9720-4345-8d76-28aa6d731e7d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:43:35 user nova-compute[75409]:   <uuid>d69ede3d-9720-4345-8d76-28aa6d731e7d</uuid>
Nov 15 21:43:35 user nova-compute[75409]:   <name>instance-00000023</name>
Nov 15 21:43:35 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:43:35 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:43:35 user nova-compute[75409]:   <metadata>
Nov 15 21:43:35 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:43:35 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-500346698</nova:name>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:43:35</nova:creationTime>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:43:35 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:43:35 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:owner>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:user uuid="5cc4ebbfd85c43b78157cd50d8d4ef24">tempest-ServerRescueNegativeTestJSON-1998844296-project-member</nova:user>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:project uuid="87098be8776c4e46abb1354048e23db4">tempest-ServerRescueNegativeTestJSON-1998844296</nova:project>
Nov 15 21:43:35 user nova-compute[75409]:       </nova:owner>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:43:35 user nova-compute[75409]:       <nova:ports>
Nov 15 21:43:35 user nova-compute[75409]:         <nova:port uuid="d8004767-204a-4628-9f48-5febae9f752c">
Nov 15 21:43:35 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 21:43:35 user nova-compute[75409]:         </nova:port>
Nov 15 21:43:35 user nova-compute[75409]:       </nova:ports>
Nov 15 21:43:35 user nova-compute[75409]:     </nova:instance>
Nov 15 21:43:35 user nova-compute[75409]:   </metadata>
Nov 15 21:43:35 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:43:35 user nova-compute[75409]:     <system>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="serial">d69ede3d-9720-4345-8d76-28aa6d731e7d</entry>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="uuid">d69ede3d-9720-4345-8d76-28aa6d731e7d</entry>
Nov 15 21:43:35 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:43:35 user nova-compute[75409]:     </system>
Nov 15 21:43:35 user nova-compute[75409]:   </sysinfo>
Nov 15 21:43:35 user nova-compute[75409]:   <os>
Nov 15 21:43:35 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:43:35 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:43:35 user nova-compute[75409]:   </os>
Nov 15 21:43:35 user nova-compute[75409]:   <features>
Nov 15 21:43:35 user nova-compute[75409]:     <acpi/>
Nov 15 21:43:35 user nova-compute[75409]:     <apic/>
Nov 15 21:43:35 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:43:35 user nova-compute[75409]:   </features>
Nov 15 21:43:35 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:43:35 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:43:35 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:43:35 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:43:35 user nova-compute[75409]:   </clock>
Nov 15 21:43:35 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:43:35 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:43:35 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:43:35 user nova-compute[75409]:   </cpu>
Nov 15 21:43:35 user nova-compute[75409]:   <devices>
Nov 15 21:43:35 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:43:35 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:43:35 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue"/>
Nov 15 21:43:35 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:43:35 user nova-compute[75409]:     </disk>
Nov 15 21:43:35 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:43:35 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:43:35 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk"/>
Nov 15 21:43:35 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:43:35 user nova-compute[75409]:     </disk>
Nov 15 21:43:35 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:43:35 user nova-compute[75409]:       <mac address="fa:16:3e:9e:b3:b8"/>
Nov 15 21:43:35 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:35 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:43:35 user nova-compute[75409]:       <target dev="tapd8004767-20"/>
Nov 15 21:43:35 user nova-compute[75409]:     </interface>
Nov 15 21:43:35 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:43:35 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/console.log" append="off"/>
Nov 15 21:43:35 user nova-compute[75409]:     </serial>
Nov 15 21:43:35 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:43:35 user nova-compute[75409]:     <video>
Nov 15 21:43:35 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:43:35 user nova-compute[75409]:     </video>
Nov 15 21:43:35 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:43:35 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:43:35 user nova-compute[75409]:     </rng>
Nov 15 21:43:35 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:43:35 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:43:35 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:43:35 user nova-compute[75409]:     </memballoon>
Nov 15 21:43:35 user nova-compute[75409]:   </devices>
Nov 15 21:43:35 user nova-compute[75409]: </domain>
Nov 15 21:43:35 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:43:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance destroyed successfully.
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:43:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] No VIF found with MAC fa:16:3e:9e:b3:b8, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:43:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:36 user nova-compute[75409]: WARNING nova.compute.manager [req-903f5c57-0e7f-4ff5-8084-d63911c2fdcf req-45b90995-af6c-4576-a81d-a2ef2c5da02e service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state rescuing.
Nov 15 21:43:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:38 user nova-compute[75409]: WARNING nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state rescuing.
Nov 15 21:43:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:43:38 user nova-compute[75409]: WARNING nova.compute.manager [req-5c6891a4-8197-4310-ad05-10ac3f032ca7 req-e63d549f-d2ab-4c17-944a-c3e74139fca3 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state rescuing.
Nov 15 21:43:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2a32926b-ca7a-4b70-859e-0193a0352ab1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:43:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:43:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:43:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:43:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=7859MB free_disk=25.11276626586914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Applying migration context for instance 07498a3f-f560-46db-9ac2-f466c7080d9c as it has an incoming, in-progress migration 51547f93-06b8-43d6-85b6-366e73bcea66. Migration status is finished {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 21:43:53 user nova-compute[75409]: INFO nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating resource usage from migration 51547f93-06b8-43d6-85b6-366e73bcea66
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 1289c06a-49b2-443e-8b08-827619529dcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Migration 51547f93-06b8-43d6-85b6-366e73bcea66 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 2faf4b51-8c78-4790-ad56-881663ac93f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:43:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:43:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:43:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [{"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:43:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-changed-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:44:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Refreshing instance network info cache due to event network-changed-ea02c839-056c-4853-a067-9308203a5349. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:44:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] Acquiring lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:44:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] Acquired lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:44:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Refreshing network info cache for port ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updated VIF entry in instance network info cache for port ea02c839-056c-4853-a067-9308203a5349. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updating instance_info_cache with network_info: [{"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b25ecde9-7481-49e7-a057-9f0b776f3b4a req-0b38ff06-b4f8-41a1-8d59-1a093697bd87 service nova] Releasing lock "refresh_cache-1289c06a-49b2-443e-8b08-827619529dcf" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:18 user nova-compute[75409]: INFO nova.compute.manager [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Terminating instance
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-unplugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] No waiting events found dispatching network-vif-unplugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:44:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-3dad4508-163b-4d9a-9eab-a2edc7884e13 req-ab966245-e5d2-4787-85f1-af1fffb9c26b service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-unplugged-ea02c839-056c-4853-a067-9308203a5349 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:19 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Instance destroyed successfully.
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid 1289c06a-49b2-443e-8b08-827619529dcf {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-936041839',display_name='tempest-TestVolumeBootPattern-server-936041839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-936041839',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:42:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-0kj2v2tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:42:37Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=1289c06a-49b2-443e-8b08-827619529dcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "ea02c839-056c-4853-a067-9308203a5349", "address": "fa:16:3e:6b:f6:6c", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02c839-05", "ovs_interfaceid": "ea02c839-056c-4853-a067-9308203a5349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_vif [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea02c839-05, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ee700df-3fa2-4b65-81c4-f73949c3edc2) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:19 user nova-compute[75409]: INFO os_vif [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:f6:6c,bridge_name='br-int',has_traffic_filtering=True,id=ea02c839-056c-4853-a067-9308203a5349,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02c839-05')
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:44:19 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5f24b-176b-47fd-a8a6-3837c6ece61e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:44:19 user nova-compute[75409]: No targets found.
Nov 15 21:44:19 user nova-compute[75409]: iSNS:
Nov 15 21:44:19 user nova-compute[75409]: No targets found.
Nov 15 21:44:19 user nova-compute[75409]: STATIC:
Nov 15 21:44:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3
Nov 15 21:44:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:44:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:44:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:44:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:19 user nova-compute[75409]: FIRMWARE:
Nov 15 21:44:19 user nova-compute[75409]: No targets found.
Nov 15 21:44:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:44:19 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:44:19 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fde7c3-3cb5-4ab2-bbfc-3f7ea2ebc96d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0910a-0fd8-48fe-8f84-62c73001c02d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:44:19 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:44:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28505bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c934736a-908d-42fd-a28d-030afb939c0b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb71f2-fed0-4294-ab9b-54b1c01f6a3c]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285b15b-baf8-4611-901a-280fee68f560]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea35f2-aaf8-40b8-9cbd-44ce2f17ddfe]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26431616433633036', '/dev/disk/by-id/scsi-1SCST_BIO516dd67e-d1ad3c06e9f38f4b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_516dd67e') {{(pid=86679) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 21:44:19 user nova-compute[75409]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26431616433633036
Nov 15 21:44:19 user nova-compute[75409]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO516dd67e-d1ad3c06e9f38f4b
Nov 15 21:44:19 user nova-compute[75409]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_516dd67e
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ac6fef-12b8-48df-b2a2-246ef88610b7]: (4, None) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548bcc3-af7c-4997-9e88-5220de0c46b6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4659428-5993-44ae-bed9-6b5809f56234]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]
Nov 15 21:44:19 user nova-compute[75409]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.
Nov 15 21:44:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de31c15-21fe-49ba-b055-f263e348f56e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (324ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:44:19 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Deleting instance files /opt/stack/data/nova/instances/1289c06a-49b2-443e-8b08-827619529dcf_del
Nov 15 21:44:19 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Deletion of /opt/stack/data/nova/instances/1289c06a-49b2-443e-8b08-827619529dcf_del complete
Nov 15 21:44:19 user nova-compute[75409]: INFO nova.compute.manager [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 21:44:19 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:44:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:44:20 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Took 0.75 seconds to deallocate network for instance.
Nov 15 21:44:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-199c738a-9a1a-41cc-8642-3435702054ed req-deeda35b-f3f0-4201-a1f5-a46ba1baa79d service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-deleted-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] Acquiring lock "1289c06a-49b2-443e-8b08-827619529dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] Lock "1289c06a-49b2-443e-8b08-827619529dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] No waiting events found dispatching network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:44:20 user nova-compute[75409]: WARNING nova.compute.manager [req-cc9dfe0b-3687-4bf1-8901-9e58d8e48a9b req-773fdc97-912b-4a22-802c-5481b561bb7c service nova] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Received unexpected event network-vif-plugged-ea02c839-056c-4853-a067-9308203a5349 for instance with vm_state active and task_state deleting.
Nov 15 21:44:21 user nova-compute[75409]: INFO nova.compute.manager [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 1289c06a-49b2-443e-8b08-827619529dcf] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 21:44:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:21 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:44:21 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:44:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:21 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance 1289c06a-49b2-443e-8b08-827619529dcf
Nov 15 21:44:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b42441ac-2378-4974-be81-6999ca372e25 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "1289c06a-49b2-443e-8b08-827619529dcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.176s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:44:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:37 user nova-compute[75409]: INFO nova.compute.manager [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Detaching volume 11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:44:37 user nova-compute[75409]: INFO nova.virt.block_device [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Attempting to driver detach volume 11793d7a-934c-4cef-8653-56509884bff3 from mountpoint /dev/vdb
Nov 15 21:44:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Attempting to detach device vdb from instance f3c2a748-56e5-49bb-bc58-a0fb96706fda from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:44:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:44:38 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:44:38 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:44:38 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:44:38 user nova-compute[75409]:   <serial>11793d7a-934c-4cef-8653-56509884bff3</serial>
Nov 15 21:44:38 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:44:38 user nova-compute[75409]: </disk>
Nov 15 21:44:38 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:44:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdb from instance f3c2a748-56e5-49bb-bc58-a0fb96706fda from the persistent domain config.
Nov 15 21:44:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3c2a748-56e5-49bb-bc58-a0fb96706fda from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:44:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:44:38 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:44:38 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:44:38 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:44:38 user nova-compute[75409]:   <serial>11793d7a-934c-4cef-8653-56509884bff3</serial>
Nov 15 21:44:38 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 21:44:38 user nova-compute[75409]: </disk>
Nov 15 21:44:38 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:44:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:44:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:44:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Going to confirm migration 2 {{(pid=75409) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'info_cache' on Instance uuid 07498a3f-f560-46db-9ac2-f466c7080d9c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:44:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'migration_context' on Instance uuid 07498a3f-f560-46db-9ac2-f466c7080d9c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG nova.objects.base [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Object Instance<07498a3f-f560-46db-9ac2-f466c7080d9c> lazy-loaded attributes: info_cache,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.400s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:51 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Deleted allocation for migration 51547f93-06b8-43d6-85b6-366e73bcea66
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1800ffef-36f8-4628-8c3b-b3084b99bfc7 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.467s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:44:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:44:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=25.110626220703125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 2faf4b51-8c78-4790-ad56-881663ac93f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:44:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:44:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:44:58 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3c2a748-56e5-49bb-bc58-a0fb96706fda is timed out.
Nov 15 21:44:58 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdb from instance f3c2a748-56e5-49bb-bc58-a0fb96706fda from the live domain config.
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfbMDqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:44:58 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1432683-7540-4d51-8d73-038a1636b6de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:44:58 user nova-compute[75409]: No targets found.
Nov 15 21:44:58 user nova-compute[75409]: iSNS:
Nov 15 21:44:58 user nova-compute[75409]: No targets found.
Nov 15 21:44:58 user nova-compute[75409]: STATIC:
Nov 15 21:44:58 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3
Nov 15 21:44:58 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:58 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:58 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3
Nov 15 21:44:58 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:58 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:58 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:44:58 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:44:58 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:44:58 user nova-compute[75409]: FIRMWARE:
Nov 15 21:44:58 user nova-compute[75409]: No targets found.
Nov 15 21:44:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:44:58 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:44:58 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[724742b3-b2d3-4832-8bbd-42cc4812da40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a4908-a118-4b5d-b60e-d34739cab543]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:44:58 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:44:58 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:44:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 (non-flash)
Nov 15 21:44:58 user nova-compute[75409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:44:58 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:44:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a2b93-903b-4715-9002-bd1fa73423c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac641a5e-2b86-4dcf-8f2d-c63a240d7940]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3858869-a484-49bd-9b44-c85d854d2bc0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [{"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-dc80da1c-5f06-44c8-bf8b-2406c22b9d73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd1ce2-859c-4b43-bfeb-00cbb34d363b]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[70124b65-2f7f-404e-82e4-b249b890ebba]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[033afa14-f274-4dbf-ac86-c1e2ea18d2be]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260]
Nov 15 21:44:58 user nova-compute[75409]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3, portal: 172.16.0.220,3260] successful.
Nov 15 21:44:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11793d7a-934c-4cef-8653-56509884bff3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81953f-a344-4c7c-8199-dd40640753d3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== disconnect_volume: return (300ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:44:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:44:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:44:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:44:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-19076e16-e930-48d2-9036-09c8eadc8873 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75409) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:00 user nova-compute[75409]: WARNING nova.compute.manager [req-b838a621-8e63-4fa4-b89d-50bb14ba3773 req-6cdc0573-8b57-4fa0-a757-639a03d9cbc5 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state active and task_state powering-off.
Nov 15 21:45:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance destroyed successfully.
Nov 15 21:45:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7f8b5110-1834-489b-997f-9f9dd0b40f14 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.875s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-changed-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Refreshing instance network info cache due to event network-changed-51967499-9898-4f65-8f19-40dd83d431f0. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] Acquiring lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] Acquired lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:45:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Refreshing network info cache for port 51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.network.neutron [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updated VIF entry in instance network info cache for port 51967499-9898-4f65-8f19-40dd83d431f0. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.network.neutron [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updating instance_info_cache with network_info: [{"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5797ed4f-eb2d-4b0a-8e51-e8fd0f70c3f8 req-65107a40-29c4-4c3a-84d9-d43c73101f2a service nova] Releasing lock "refresh_cache-2faf4b51-8c78-4790-ad56-881663ac93f4" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:02 user nova-compute[75409]: WARNING nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:02 user nova-compute[75409]: WARNING nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:02 user nova-compute[75409]: WARNING nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:02 user nova-compute[75409]: WARNING nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:02 user nova-compute[75409]: WARNING nova.compute.manager [req-a658fca9-9df3-4c0e-aacf-5acfbae8d253 req-cc70af99-063d-4ed2-ac59-c2d204f935f6 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state None.
Nov 15 21:45:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:04 user nova-compute[75409]: INFO nova.compute.manager [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Attaching volume 5c00b013-a4b7-46c5-9617-2a17498d0821 to /dev/vdb
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5443ee1e-70f0-4747-884f-1e0fe6f33523]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02c5e94-8468-49fe-aca2-9d671c30dd86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40424e6b-8f4c-4a19-b25b-66e271d6f396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ff549-6b2d-4fa1-834f-a6f7195752d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:45:04 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:45:04 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf26acb-9e2a-4ba8-be8b-219a8c46d4a7]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG os_brick.utils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:45:04 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updating existing volume attachment record: 1c0214b5-6835-4af6-aa70-01abea2c8166 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvzsxrlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:45:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:45:09 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:45:09 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96f2744-58fb-4577-aaf9-dfc1f746dc41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:45:09 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[58748c8b-fabf-43b4-b6a2-f7d9379cce38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821] added
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc08fcb-dda8-40ff-9c28-a187fd70e80a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4baf9-95a5-4856-a425-a8de46674d2a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvzsxrlG {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvzsxrlG" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82eb10a-3ea2-4e80-8d29-fc812bc4c4c8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BvzsxrlG'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0606a5cd-928a-4551-9079-ffc89f7b7642]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4521214-ab63-46fb-aa2d-857455bc3a9a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f86d8a-a50d-4e30-9652-c19525f57419]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260]
Nov 15 21:45:09 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260] successful.
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f3eed3-e511-411f-b384-bdafca180706]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917364c-d587-414b-a2f1-61bc50e51bc7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:09 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea418d95-a209-4d61-a5d6-6d8a7f951366]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvzsxrlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:45:10 user nova-compute[75409]: INFO nova.compute.claims [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Claim successful on node user
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:45:10 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.policy [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:45:10 user nova-compute[75409]: INFO nova.virt.block_device [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Booting with volume f36bd677-ec27-46cd-8d43-88c6d3265f09 at /dev/vda
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.utils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eb9112-43be-4436-8fd1-d53594fd587b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae70201-7555-4784-b77c-082ba4ce4482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4af47d-c847-42f2-b1c7-761cdf813eb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001efa4-6021-4f13-8d39-829a1d082ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:45:10 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:45:10 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec731e5-aaf1-4c51-be65-1981ea9c38c2]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.utils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating existing volume attachment record: dae9c90e-fedd-4c5f-95a1-647bf786907b {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23430336666333833', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430336666333833', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:45:10 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:45:10 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:45:10 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:45:10 user nova-compute[75409]:   <serial>5c00b013-a4b7-46c5-9617-2a17498d0821</serial>
Nov 15 21:45:10 user nova-compute[75409]: </disk>
Nov 15 21:45:10 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Successfully created port: 0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:7a:1f:e2, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2161c16b-8bce-4b69-9ff9-3a1a04fc6bc7 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.728s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Successfully updated port: 0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing instance network info cache due to event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] Acquiring lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:45:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating instance_info_cache with network_info: [{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Instance network_info: |[{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] Acquired lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updated VIF entry in instance network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.network.neutron [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating instance_info_cache with network_info: [{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-080f202e-3206-4896-bd04-142ba0be993a req-2824852b-d9d4-44d3-a23f-a47bbaabbaf8 service nova] Releasing lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:12 user nova-compute[75409]: INFO nova.compute.manager [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Detaching volume 5c00b013-a4b7-46c5-9617-2a17498d0821
Nov 15 21:45:12 user nova-compute[75409]: INFO nova.virt.block_device [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Attempting to driver detach volume 5c00b013-a4b7-46c5-9617-2a17498d0821 from mountpoint /dev/vdb
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Attempting to detach device vdb from instance 2faf4b51-8c78-4790-ad56-881663ac93f4 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:45:12 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:45:12 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:45:12 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:45:12 user nova-compute[75409]:   <serial>5c00b013-a4b7-46c5-9617-2a17498d0821</serial>
Nov 15 21:45:12 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:45:12 user nova-compute[75409]: </disk>
Nov 15 21:45:12 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:45:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance 2faf4b51-8c78-4790-ad56-881663ac93f4 from the persistent domain config.
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2faf4b51-8c78-4790-ad56-881663ac93f4 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:45:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:45:12 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:45:12 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:45:12 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:45:12 user nova-compute[75409]:   <serial>5c00b013-a4b7-46c5-9617-2a17498d0821</serial>
Nov 15 21:45:12 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:45:12 user nova-compute[75409]: </disk>
Nov 15 21:45:12 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:45:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:45:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:45:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Creating image(s)
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Ensure instance console log exists: /opt/stack/data/nova/instances/e7a03aa8-3505-4d30-9929-abe6e0363e94/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Start _get_guest_xml network_info=[{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7a03aa8-3505-4d30-9929-abe6e0363e94', 'attached_at': '', 'detached_at': '', 'volume_id': 'f36bd677-ec27-46cd-8d43-88c6d3265f09', 'serial': 'f36bd677-ec27-46cd-8d43-88c6d3265f09'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'dae9c90e-fedd-4c5f-95a1-647bf786907b', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:45:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:45:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:45:15 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:45:15 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:45:15 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2650f28f-dec2-4943-bfb6-3fbca6f12f0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:45:15 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6946358c-7c56-4d15-b5d7-417e424e0753]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09] added
Nov 15 21:45:15 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad63ce6-175a-4091-9916-d4e95e3c9306]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88e8d6-f122-48b5-b907-0d6bb995be0c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOKYVCjP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOKYVCjP" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c081f3-c25f-4f8f-8478-039e5c37266b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOKYVCjP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27fd85d-2c09-4c29-90b7-3b383eea96b9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a8847-f389-448e-b327-4bafee91d26d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda8e76-0f13-4fae-a528-720ea34df232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]
Nov 15 21:45:16 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.
Nov 15 21:45:16 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[12173f5e-24e1-4455-bc3a-ed30100057ea]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2de26-9768-416c-b162-9a9aa929d576]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:45:16 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555cdc6-0069-4906-855e-def6a249bb8d]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:45:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26431616433633036', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431616433633036', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-425373142',display_name='tempest-TestVolumeBootPattern-server-425373142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-425373142',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-x1ssug9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:45:11Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=e7a03aa8-3505-4d30-9929-abe6e0363e94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid e7a03aa8-3505-4d30-9929-abe6e0363e94 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:45:17 user nova-compute[75409]:   <uuid>e7a03aa8-3505-4d30-9929-abe6e0363e94</uuid>
Nov 15 21:45:17 user nova-compute[75409]:   <name>instance-00000026</name>
Nov 15 21:45:17 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:45:17 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:45:17 user nova-compute[75409]:   <metadata>
Nov 15 21:45:17 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:45:17 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:45:17 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-server-425373142</nova:name>
Nov 15 21:45:17 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:45:15</nova:creationTime>
Nov 15 21:45:17 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:45:17 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:45:17 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:45:17 user nova-compute[75409]:       <nova:owner>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:45:17 user nova-compute[75409]:       </nova:owner>
Nov 15 21:45:17 user nova-compute[75409]:       <nova:ports>
Nov 15 21:45:17 user nova-compute[75409]:         <nova:port uuid="0ef3bfa3-afab-4d95-8771-c43422f2ee82">
Nov 15 21:45:17 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 21:45:17 user nova-compute[75409]:         </nova:port>
Nov 15 21:45:17 user nova-compute[75409]:       </nova:ports>
Nov 15 21:45:17 user nova-compute[75409]:     </nova:instance>
Nov 15 21:45:17 user nova-compute[75409]:   </metadata>
Nov 15 21:45:17 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:45:17 user nova-compute[75409]:     <system>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="serial">e7a03aa8-3505-4d30-9929-abe6e0363e94</entry>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="uuid">e7a03aa8-3505-4d30-9929-abe6e0363e94</entry>
Nov 15 21:45:17 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:45:17 user nova-compute[75409]:     </system>
Nov 15 21:45:17 user nova-compute[75409]:   </sysinfo>
Nov 15 21:45:17 user nova-compute[75409]:   <os>
Nov 15 21:45:17 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:45:17 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:45:17 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:45:17 user nova-compute[75409]:   </os>
Nov 15 21:45:17 user nova-compute[75409]:   <features>
Nov 15 21:45:17 user nova-compute[75409]:     <acpi/>
Nov 15 21:45:17 user nova-compute[75409]:     <apic/>
Nov 15 21:45:17 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:45:17 user nova-compute[75409]:   </features>
Nov 15 21:45:17 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:45:17 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:45:17 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:45:17 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:45:17 user nova-compute[75409]:   </clock>
Nov 15 21:45:17 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:45:17 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:45:17 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:45:17 user nova-compute[75409]:   </cpu>
Nov 15 21:45:17 user nova-compute[75409]:   <devices>
Nov 15 21:45:17 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:45:17 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:45:17 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:45:17 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:45:17 user nova-compute[75409]:       <serial>f36bd677-ec27-46cd-8d43-88c6d3265f09</serial>
Nov 15 21:45:17 user nova-compute[75409]:     </disk>
Nov 15 21:45:17 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:45:17 user nova-compute[75409]:       <mac address="fa:16:3e:3b:15:69"/>
Nov 15 21:45:17 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:45:17 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:45:17 user nova-compute[75409]:       <target dev="tap0ef3bfa3-af"/>
Nov 15 21:45:17 user nova-compute[75409]:     </interface>
Nov 15 21:45:17 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:45:17 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/e7a03aa8-3505-4d30-9929-abe6e0363e94/console.log" append="off"/>
Nov 15 21:45:17 user nova-compute[75409]:     </serial>
Nov 15 21:45:17 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:45:17 user nova-compute[75409]:     <video>
Nov 15 21:45:17 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:45:17 user nova-compute[75409]:     </video>
Nov 15 21:45:17 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:45:17 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:45:17 user nova-compute[75409]:     </rng>
Nov 15 21:45:17 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:45:17 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:45:17 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:45:17 user nova-compute[75409]:     </memballoon>
Nov 15 21:45:17 user nova-compute[75409]:   </devices>
Nov 15 21:45:17 user nova-compute[75409]: </domain>
Nov 15 21:45:17 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-425373142',display_name='tempest-TestVolumeBootPattern-server-425373142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-425373142',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-x1ssug9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:45:11Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=e7a03aa8-3505-4d30-9929-abe6e0363e94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG os_vif [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39b469f6-3697-5f7d-a6d5-171f5a3bb758', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef3bfa3-af, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ef3bfa3-af, col_values=(('qos', UUID('43899652-3c2b-451b-a33e-a1a9a3241c73')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ef3bfa3-af, col_values=(('external_ids', {'iface-id': '0ef3bfa3-afab-4d95-8771-c43422f2ee82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:15:69', 'vm-uuid': 'e7a03aa8-3505-4d30-9929-abe6e0363e94'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:17 user nova-compute[75409]: INFO os_vif [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af')
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:45:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:3b:15:69, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] No waiting events found dispatching network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:18 user nova-compute[75409]: WARNING nova.compute.manager [req-1013aeda-8c63-4315-84e5-2ae1895de8a9 req-aed16a85-1913-4658-bda9-6c88011f69b5 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received unexpected event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 for instance with vm_state building and task_state spawning.
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] No waiting events found dispatching network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:20 user nova-compute[75409]: WARNING nova.compute.manager [req-8c96cc4b-4a73-446e-b647-77c6f42490df req-4b23a4e7-8861-494f-b723-65c3f3fe321f service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received unexpected event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 for instance with vm_state building and task_state spawning.
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:45:20 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Instance spawned successfully.
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:20 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:45:21 user nova-compute[75409]: INFO nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 21:45:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:45:21 user nova-compute[75409]: INFO nova.compute.manager [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Took 11.03 seconds to build instance.
Nov 15 21:45:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f4453c6f-b630-4ff3-94b9-82ea4419ab54 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.153s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:25 user nova-compute[75409]: INFO nova.compute.manager [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Unrescuing
Nov 15 21:45:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'flavor' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:26 user nova-compute[75409]: DEBUG nova.compute.manager [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:26 user nova-compute[75409]: WARNING nova.compute.manager [req-e357972f-ead2-45ef-8478-5f7f9c56b0b4 req-9b2d405b-9fab-41ff-a63c-c168aa12b389 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:45:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance destroyed successfully.
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:28 user nova-compute[75409]: WARNING nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:45:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:28 user nova-compute[75409]: DEBUG nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:28 user nova-compute[75409]: WARNING nova.compute.manager [req-f2b32e21-0aed-43a3-8fb2-cc6f9b3e2e30 req-73464175-fe03-4954-b996-a07708a9fae9 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state rescued and task_state unrescuing.
Nov 15 21:45:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5d2709b0-9b05-412f-8d0f-965cb9dfee63 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:45:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:45:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:30 user nova-compute[75409]: DEBUG nova.compute.manager [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:45:30 user nova-compute[75409]: WARNING nova.compute.manager [req-d3dd7f00-4ac1-4cbc-b78f-094d67f525b2 req-89f69fb8-c053-4141-be0d-353ea9dc673c service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state active and task_state None.
Nov 15 21:45:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:33 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2faf4b51-8c78-4790-ad56-881663ac93f4 is timed out.
Nov 15 21:45:33 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance 2faf4b51-8c78-4790-ad56-881663ac93f4 from the live domain config.
Nov 15 21:45:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvzsxrlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:45:33 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8889858-2d61-421b-afb6-6163553f1c9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:45:33 user nova-compute[75409]: No targets found.
Nov 15 21:45:33 user nova-compute[75409]: iSNS:
Nov 15 21:45:33 user nova-compute[75409]: No targets found.
Nov 15 21:45:33 user nova-compute[75409]: STATIC:
Nov 15 21:45:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3
Nov 15 21:45:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:45:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:45:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:45:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:45:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:45:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821
Nov 15 21:45:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:45:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:45:33 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:45:33 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:45:33 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:45:33 user nova-compute[75409]: FIRMWARE:
Nov 15 21:45:33 user nova-compute[75409]: No targets found.
Nov 15 21:45:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:45:33 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:45:33 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12d0db1-2fa5-406e-94d1-14fe755614b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be47524-6d42-4367-baf7-68e6c70e97fe]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:45:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf285560e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7c1997-9425-4b00-be65-dd8351db5e33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd776252-5e9b-4328-ad13-db0b2958a9db]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a896c216-2443-492d-820e-372e0a2f6b91]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd05159-f62d-4d94-bd0d-7a072bcbd56c]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28bfce6-319f-4cfe-8e5e-d2050dd3820d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[298fc00b-2010-47d8-9976-055ccc84f318]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260]
Nov 15 21:45:33 user nova-compute[75409]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821, portal: 172.16.0.220,3260] successful.
Nov 15 21:45:33 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00b013-a4b7-46c5-9617-2a17498d0821 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73405b78-b4e0-4a95-9637-c7bca34d878a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== disconnect_volume: return (336ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:45:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:45:34 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:45:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a0794ac7-795c-4bcf-a1e4-2dd7c9456a37 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:45:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:45:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:45:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:45:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:45:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.10753631591797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 2faf4b51-8c78-4790-ad56-881663ac93f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e7a03aa8-3505-4d30-9929-abe6e0363e94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:45:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:45:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:45:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:46:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:46:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:03 user nova-compute[75409]: INFO nova.compute.manager [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Terminating instance
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-unplugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] No waiting events found dispatching network-vif-unplugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-5b025b17-e54e-4665-b638-f445bd1a6064 req-55776de1-1cd7-45d3-92ee-097f60b9c82b service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-unplugged-51967499-9898-4f65-8f19-40dd83d431f0 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Instance destroyed successfully.
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'resources' on Instance uuid 2faf4b51-8c78-4790-ad56-881663ac93f4 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-478638340',display_name='tempest-AttachVolumeNegativeTest-server-478638340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-478638340',id=37,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0bsCJUlMvUsOB+JTj/Cc/7BwH9MQcesIHrwXAUBwipxPOOqwRPSHnTvFWEAjMqXuiRtlbwvnc40N9xlovbf7LZ047oLMKwnlfe90yLXBQk1PDDiVhx4z/n2SmHIDjp9g==',key_name='tempest-keypair-1681312184',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-ybhxepk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=2faf4b51-8c78-4790-ad56-881663ac93f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "51967499-9898-4f65-8f19-40dd83d431f0", "address": "fa:16:3e:7a:1f:e2", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51967499-98", "ovs_interfaceid": "51967499-9898-4f65-8f19-40dd83d431f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG os_vif [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51967499-98, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b9056fc-8187-4fcb-a5e0-d856c7ed36e4) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:03 user nova-compute[75409]: INFO os_vif [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:1f:e2,bridge_name='br-int',has_traffic_filtering=True,id=51967499-9898-4f65-8f19-40dd83d431f0,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51967499-98')
Nov 15 21:46:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Deleting instance files /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4_del
Nov 15 21:46:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Deletion of /opt/stack/data/nova/instances/2faf4b51-8c78-4790-ad56-881663ac93f4_del complete
Nov 15 21:46:04 user nova-compute[75409]: INFO nova.compute.manager [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 21:46:04 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:46:04 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Took 0.61 seconds to deallocate network for instance.
Nov 15 21:46:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:46:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:04 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Deleted allocations for instance 2faf4b51-8c78-4790-ad56-881663ac93f4
Nov 15 21:46:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f780f3f9-3e18-4ab9-b41b-6639f50b9f7d tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] Acquiring lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] Lock "2faf4b51-8c78-4790-ad56-881663ac93f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] No waiting events found dispatching network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:46:05 user nova-compute[75409]: WARNING nova.compute.manager [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received unexpected event network-vif-plugged-51967499-9898-4f65-8f19-40dd83d431f0 for instance with vm_state deleted and task_state None.
Nov 15 21:46:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-25a6eb55-f93a-4ecf-9112-31324993a920 req-15bd2b5c-fe00-4712-b934-9ea837855c6c service nova] [instance: 2faf4b51-8c78-4790-ad56-881663ac93f4] Received event network-vif-deleted-51967499-9898-4f65-8f19-40dd83d431f0 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:46:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:41 user nova-compute[75409]: INFO nova.compute.manager [None req-cd66e4c1-3781-4d22-b580-2d09aa3a383c tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Get console output
Nov 15 21:46:41 user nova-compute[75409]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 21:46:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquired lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG nova.network.neutron [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'info_cache' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:51 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.neutron [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Releasing lock "refresh_cache-f3c2a748-56e5-49bb-bc58-a0fb96706fda" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:46:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance destroyed successfully.
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'resources' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG os_vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c482854-d2, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b8674a3-a2a2-4fda-96f2-aa36986fb48b) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: INFO os_vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start _get_guest_xml network_info=[{"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'numa_topology' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:52 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:46:52 user nova-compute[75409]:   <uuid>f3c2a748-56e5-49bb-bc58-a0fb96706fda</uuid>
Nov 15 21:46:52 user nova-compute[75409]:   <name>instance-00000021</name>
Nov 15 21:46:52 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:46:52 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:46:52 user nova-compute[75409]:   <metadata>
Nov 15 21:46:52 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:46:52 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeTestJSON-server-1716788624</nova:name>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:46:52</nova:creationTime>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:46:52 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:46:52 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:owner>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:user uuid="e867fa9de5b345518d1e7bea923f8e55">tempest-AttachVolumeTestJSON-753726309-project-member</nova:user>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:project uuid="fbce891b648d4fa299edae25edf1965a">tempest-AttachVolumeTestJSON-753726309</nova:project>
Nov 15 21:46:52 user nova-compute[75409]:       </nova:owner>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:46:52 user nova-compute[75409]:       <nova:ports>
Nov 15 21:46:52 user nova-compute[75409]:         <nova:port uuid="9c482854-d245-4c9e-8092-5e046c8ea6b2">
Nov 15 21:46:52 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:46:52 user nova-compute[75409]:         </nova:port>
Nov 15 21:46:52 user nova-compute[75409]:       </nova:ports>
Nov 15 21:46:52 user nova-compute[75409]:     </nova:instance>
Nov 15 21:46:52 user nova-compute[75409]:   </metadata>
Nov 15 21:46:52 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:46:52 user nova-compute[75409]:     <system>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="serial">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="uuid">f3c2a748-56e5-49bb-bc58-a0fb96706fda</entry>
Nov 15 21:46:52 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:46:52 user nova-compute[75409]:     </system>
Nov 15 21:46:52 user nova-compute[75409]:   </sysinfo>
Nov 15 21:46:52 user nova-compute[75409]:   <os>
Nov 15 21:46:52 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:46:52 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:46:52 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:46:52 user nova-compute[75409]:   </os>
Nov 15 21:46:52 user nova-compute[75409]:   <features>
Nov 15 21:46:52 user nova-compute[75409]:     <acpi/>
Nov 15 21:46:52 user nova-compute[75409]:     <apic/>
Nov 15 21:46:52 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:46:52 user nova-compute[75409]:   </features>
Nov 15 21:46:52 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:46:52 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:46:52 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:46:52 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:46:52 user nova-compute[75409]:   </clock>
Nov 15 21:46:52 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:46:52 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:46:52 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:46:52 user nova-compute[75409]:   </cpu>
Nov 15 21:46:52 user nova-compute[75409]:   <devices>
Nov 15 21:46:52 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:46:52 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:46:52 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk"/>
Nov 15 21:46:52 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:46:52 user nova-compute[75409]:     </disk>
Nov 15 21:46:52 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:46:52 user nova-compute[75409]:       <mac address="fa:16:3e:e7:6a:61"/>
Nov 15 21:46:52 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:46:52 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:46:52 user nova-compute[75409]:       <target dev="tap9c482854-d2"/>
Nov 15 21:46:52 user nova-compute[75409]:     </interface>
Nov 15 21:46:52 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:46:52 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/console.log" append="off"/>
Nov 15 21:46:52 user nova-compute[75409]:     </serial>
Nov 15 21:46:52 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:46:52 user nova-compute[75409]:     <video>
Nov 15 21:46:52 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:46:52 user nova-compute[75409]:     </video>
Nov 15 21:46:52 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:46:52 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:46:52 user nova-compute[75409]:     </rng>
Nov 15 21:46:52 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:46:52 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:46:52 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:46:52 user nova-compute[75409]:     </memballoon>
Nov 15 21:46:52 user nova-compute[75409]:   </devices>
Nov 15 21:46:52 user nova-compute[75409]: </domain>
Nov 15 21:46:52 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'migration_context' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.objects.base [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Object Instance<f3c2a748-56e5-49bb-bc58-a0fb96706fda> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:45:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG os_vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c976385a-d566-5cea-a715-286d16b4be5f', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c482854-d2, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c482854-d2, col_values=(('qos', UUID('18f376a0-7087-4865-a476-7c20a1ae132e')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c482854-d2, col_values=(('external_ids', {'iface-id': '9c482854-d245-4c9e-8092-5e046c8ea6b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6a:61', 'vm-uuid': 'f3c2a748-56e5-49bb-bc58-a0fb96706fda'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:52 user nova-compute[75409]: INFO os_vif [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:46:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:46:56 user nova-compute[75409]: WARNING nova.compute.manager [req-206fb0cf-ac2c-4da6-acbf-88a82ef9e00e req-dd29e02e-bd2a-4158-8543-ad0fa883912c service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state powering-on.
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:46:56 user nova-compute[75409]: WARNING nova.compute.manager [req-ffb35d95-2425-48dc-9b4c-be9d5876da6d req-9a74794f-5719-4453-bb10-8f6ec3ba5ee4 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state stopped and task_state powering-on.
Nov 15 21:46:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=25.126689910888672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance rebooted successfully.
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-474a0192-efc3-4644-a957-cd869a43ed85 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 07498a3f-f560-46db-9ac2-f466c7080d9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e7a03aa8-3505-4d30-9929-abe6e0363e94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:46:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:46:57 user nova-compute[75409]: INFO nova.compute.claims [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Claim successful on node user
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:46:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.policy [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '752b5dc398bb45608817b61c4ccbfb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d9e1e2556e4ec396ccabb7f7126bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:46:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Creating image(s)
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "/opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk 1073741824" returned: 0 in 0.053s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Cannot resize image /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Ensure instance console log exists: /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:46:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Successfully created port: c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Successfully updated port: c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquired lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-changed-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Refreshing instance network info cache due to event network-changed-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] Acquiring lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updating instance_info_cache with network_info: [{"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Releasing lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Instance network_info: |[{"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] Acquired lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Refreshing network info cache for port c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Start _get_guest_xml network_info=[{"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:46:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110545822',display_name='tempest-AttachVolumeNegativeTest-server-2110545822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110545822',id=39,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7O7NnqpL0rtEVIhiQA0JlNlPF5FIr2dnfa09Hu0e4pzevXIoHkJmlXkFKSMQ/A50gF5hGhwudkj94AgzqOZhhD5E0G0RF8L16kRfrPDI0kuHQKbzIbrhxWpAAzI4XukA==',key_name='tempest-keypair-1353848472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-mt413rtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=ddbbceaa-3054-4744-82a2-510f6f801d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'pci_devices' on Instance uuid ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:46:59 user nova-compute[75409]:   <uuid>ddbbceaa-3054-4744-82a2-510f6f801d4b</uuid>
Nov 15 21:46:59 user nova-compute[75409]:   <name>instance-00000027</name>
Nov 15 21:46:59 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:46:59 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:46:59 user nova-compute[75409]:   <metadata>
Nov 15 21:46:59 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:46:59 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2110545822</nova:name>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:46:59</nova:creationTime>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:46:59 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:46:59 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:owner>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:user uuid="752b5dc398bb45608817b61c4ccbfb8b">tempest-AttachVolumeNegativeTest-1984244406-project-member</nova:user>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:project uuid="45d9e1e2556e4ec396ccabb7f7126bf0">tempest-AttachVolumeNegativeTest-1984244406</nova:project>
Nov 15 21:46:59 user nova-compute[75409]:       </nova:owner>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:46:59 user nova-compute[75409]:       <nova:ports>
Nov 15 21:46:59 user nova-compute[75409]:         <nova:port uuid="c8292ca7-c7fa-4e7d-9da0-073b8ee675a9">
Nov 15 21:46:59 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 21:46:59 user nova-compute[75409]:         </nova:port>
Nov 15 21:46:59 user nova-compute[75409]:       </nova:ports>
Nov 15 21:46:59 user nova-compute[75409]:     </nova:instance>
Nov 15 21:46:59 user nova-compute[75409]:   </metadata>
Nov 15 21:46:59 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:46:59 user nova-compute[75409]:     <system>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="serial">ddbbceaa-3054-4744-82a2-510f6f801d4b</entry>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="uuid">ddbbceaa-3054-4744-82a2-510f6f801d4b</entry>
Nov 15 21:46:59 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:46:59 user nova-compute[75409]:     </system>
Nov 15 21:46:59 user nova-compute[75409]:   </sysinfo>
Nov 15 21:46:59 user nova-compute[75409]:   <os>
Nov 15 21:46:59 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:46:59 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:46:59 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:46:59 user nova-compute[75409]:   </os>
Nov 15 21:46:59 user nova-compute[75409]:   <features>
Nov 15 21:46:59 user nova-compute[75409]:     <acpi/>
Nov 15 21:46:59 user nova-compute[75409]:     <apic/>
Nov 15 21:46:59 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:46:59 user nova-compute[75409]:   </features>
Nov 15 21:46:59 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:46:59 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:46:59 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:46:59 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:46:59 user nova-compute[75409]:   </clock>
Nov 15 21:46:59 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:46:59 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:46:59 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:46:59 user nova-compute[75409]:   </cpu>
Nov 15 21:46:59 user nova-compute[75409]:   <devices>
Nov 15 21:46:59 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:46:59 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:46:59 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk"/>
Nov 15 21:46:59 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:46:59 user nova-compute[75409]:     </disk>
Nov 15 21:46:59 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:46:59 user nova-compute[75409]:       <mac address="fa:16:3e:0d:50:9b"/>
Nov 15 21:46:59 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:46:59 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:46:59 user nova-compute[75409]:       <target dev="tapc8292ca7-c7"/>
Nov 15 21:46:59 user nova-compute[75409]:     </interface>
Nov 15 21:46:59 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:46:59 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/console.log" append="off"/>
Nov 15 21:46:59 user nova-compute[75409]:     </serial>
Nov 15 21:46:59 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:46:59 user nova-compute[75409]:     <video>
Nov 15 21:46:59 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:46:59 user nova-compute[75409]:     </video>
Nov 15 21:46:59 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:46:59 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:46:59 user nova-compute[75409]:     </rng>
Nov 15 21:46:59 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:46:59 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:46:59 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:46:59 user nova-compute[75409]:     </memballoon>
Nov 15 21:46:59 user nova-compute[75409]:   </devices>
Nov 15 21:46:59 user nova-compute[75409]: </domain>
Nov 15 21:46:59 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110545822',display_name='tempest-AttachVolumeNegativeTest-server-2110545822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110545822',id=39,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7O7NnqpL0rtEVIhiQA0JlNlPF5FIr2dnfa09Hu0e4pzevXIoHkJmlXkFKSMQ/A50gF5hGhwudkj94AgzqOZhhD5E0G0RF8L16kRfrPDI0kuHQKbzIbrhxWpAAzI4XukA==',key_name='tempest-keypair-1353848472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-mt413rtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=ddbbceaa-3054-4744-82a2-510f6f801d4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG os_vif [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '266416d7-2768-5ffb-9bc9-c21080a682eb', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:46:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8292ca7-c7, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8292ca7-c7, col_values=(('qos', UUID('04255254-0176-4b08-a56b-d43a6f443d13')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8292ca7-c7, col_values=(('external_ids', {'iface-id': 'c8292ca7-c7fa-4e7d-9da0-073b8ee675a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:50:9b', 'vm-uuid': 'ddbbceaa-3054-4744-82a2-510f6f801d4b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:00 user nova-compute[75409]: INFO os_vif [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7')
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:0d:50:9b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updated VIF entry in instance network info cache for port c8292ca7-c7fa-4e7d-9da0-073b8ee675a9. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updating instance_info_cache with network_info: [{"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-74aae4b0-9a23-415e-9c93-2eff85302f5c req-5a804a21-f9cf-403d-ad6a-573aad0ab5b0 service nova] Releasing lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [{"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-07498a3f-f560-46db-9ac2-f466c7080d9c" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:47:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] No waiting events found dispatching network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:01 user nova-compute[75409]: WARNING nova.compute.manager [req-86039418-8f19-40da-826a-3994f1f42a1e req-892c7a75-ef52-42fc-a542-e2de4280c54a service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received unexpected event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 for instance with vm_state building and task_state spawning.
Nov 15 21:47:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing instance network info cache due to event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] Acquiring lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] Acquired lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG nova.network.neutron [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG nova.network.neutron [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updated VIF entry in instance network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG nova.network.neutron [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating instance_info_cache with network_info: [{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-31e4144d-57ea-47cc-8398-ea962ddc4261 req-4a0d1f9c-90f8-46a2-93d5-3b47a0c3cda0 service nova] Releasing lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:47:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Instance spawned successfully.
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] No waiting events found dispatching network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:03 user nova-compute[75409]: WARNING nova.compute.manager [req-36d0439c-ee61-4cd4-805f-88f9b803a031 req-1829936c-d181-47c9-b0cf-b121cb112466 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received unexpected event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 for instance with vm_state building and task_state spawning.
Nov 15 21:47:03 user nova-compute[75409]: INFO nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 15 21:47:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:47:03 user nova-compute[75409]: INFO nova.compute.manager [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Took 6.69 seconds to build instance.
Nov 15 21:47:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b115e145-7d64-4e4d-8cf5-0466cd1a4c82 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.832s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:07 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:47:07 user nova-compute[75409]: INFO nova.compute.claims [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Claim successful on node user
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:47:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.policy [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd99af4b031fd4f3da8957b9bd64dda26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bbdc35dddf43868e00e37786d69e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:47:08 user nova-compute[75409]: INFO nova.virt.block_device [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Booting with volume 0de04733-3d9f-47c0-b41a-8f1e06c29131 at /dev/vda
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75bb38-556a-4109-b24d-04fb365e2a66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69eea03-94e4-4a77-8a53-92865742ef27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170cbc9-a66d-4421-ad7d-1baef419a8ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262be6d-296d-4e0e-84d9-4da7fba488c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:47:08 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:47:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f7f20-985d-4628-8cce-58cc86e5fda4]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:47:08 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating existing volume attachment record: d9215102-6667-41f8-8fbc-0385dc580b2a {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Successfully created port: 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Successfully updated port: 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquired lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing instance network info cache due to event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] Acquiring lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:47:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating instance_info_cache with network_info: [{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Releasing lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Instance network_info: |[{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] Acquired lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updated VIF entry in instance network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating instance_info_cache with network_info: [{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3327c52a-8b50-498c-9201-587eb5e4343b req-91ffc34a-6a99-4311-b240-0b5f38e9879d service nova] Releasing lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:47:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Creating image(s)
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Ensure instance console log exists: /opt/stack/data/nova/instances/882da7a0-cb5b-4956-984d-d9f03fb9762b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Start _get_guest_xml network_info=[{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwDxXIQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '882da7a0-cb5b-4956-984d-d9f03fb9762b', 'attached_at': '', 'detached_at': '', 'volume_id': '0de04733-3d9f-47c0-b41a-8f1e06c29131', 'serial': '0de04733-3d9f-47c0-b41a-8f1e06c29131'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'd9215102-6667-41f8-8fbc-0385dc580b2a', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:47:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:47:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwDxXIQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:47:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:47:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:47:13 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e8d28-3588-4b6c-a46b-9dc3a7817cef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:47:13 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d3a5af-b9d0-400b-992f-d13ff0ad8a1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131] added
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f46782-e7a5-42f1-8132-464292516232]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa9dff2-e950-4f61-af66-c8e346ae0dee]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwDxXIQV {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwDxXIQV" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31240964-d0ad-49bb-9897-32cd6c44afa4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TwDxXIQV'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0746f65-6f3d-4331-a1e7-1ae492212292]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b30db78-27b3-482d-a77d-ed400857fce6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a0c66-90a2-429a-a8ac-c0133de0845d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260]
Nov 15 21:47:13 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260] successful.
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4e0fc-428d-4a77-8307-6557840452eb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12bd7e-4651-47d7-ac57-4168f9d1bf42]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f8c22-00ba-4828-99b9-2589b538914c]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:47:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwDxXIQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:47:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:47:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26435306235633839', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:47:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435306235633839', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:47:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2060632717',display_name='tempest-TestVolumeBootPattern-server-2060632717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2060632717',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-uwnee7o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:47:08Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=882da7a0-cb5b-4956-984d-d9f03fb9762b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'pci_devices' on Instance uuid 882da7a0-cb5b-4956-984d-d9f03fb9762b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:47:15 user nova-compute[75409]:   <uuid>882da7a0-cb5b-4956-984d-d9f03fb9762b</uuid>
Nov 15 21:47:15 user nova-compute[75409]:   <name>instance-00000028</name>
Nov 15 21:47:15 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:47:15 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:47:15 user nova-compute[75409]:   <metadata>
Nov 15 21:47:15 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:47:15 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:47:15 user nova-compute[75409]:       <nova:name>tempest-TestVolumeBootPattern-server-2060632717</nova:name>
Nov 15 21:47:15 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:47:13</nova:creationTime>
Nov 15 21:47:15 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:47:15 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:47:15 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:47:15 user nova-compute[75409]:       <nova:owner>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:user uuid="d99af4b031fd4f3da8957b9bd64dda26">tempest-TestVolumeBootPattern-2009063389-project-member</nova:user>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:project uuid="81bbdc35dddf43868e00e37786d69e6c">tempest-TestVolumeBootPattern-2009063389</nova:project>
Nov 15 21:47:15 user nova-compute[75409]:       </nova:owner>
Nov 15 21:47:15 user nova-compute[75409]:       <nova:ports>
Nov 15 21:47:15 user nova-compute[75409]:         <nova:port uuid="0318c846-7c70-4708-9ad9-fe5ab5ca5aa5">
Nov 15 21:47:15 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:47:15 user nova-compute[75409]:         </nova:port>
Nov 15 21:47:15 user nova-compute[75409]:       </nova:ports>
Nov 15 21:47:15 user nova-compute[75409]:     </nova:instance>
Nov 15 21:47:15 user nova-compute[75409]:   </metadata>
Nov 15 21:47:15 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:47:15 user nova-compute[75409]:     <system>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="serial">882da7a0-cb5b-4956-984d-d9f03fb9762b</entry>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="uuid">882da7a0-cb5b-4956-984d-d9f03fb9762b</entry>
Nov 15 21:47:15 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:47:15 user nova-compute[75409]:     </system>
Nov 15 21:47:15 user nova-compute[75409]:   </sysinfo>
Nov 15 21:47:15 user nova-compute[75409]:   <os>
Nov 15 21:47:15 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:47:15 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:47:15 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:47:15 user nova-compute[75409]:   </os>
Nov 15 21:47:15 user nova-compute[75409]:   <features>
Nov 15 21:47:15 user nova-compute[75409]:     <acpi/>
Nov 15 21:47:15 user nova-compute[75409]:     <apic/>
Nov 15 21:47:15 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:47:15 user nova-compute[75409]:   </features>
Nov 15 21:47:15 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:47:15 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:47:15 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:47:15 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:47:15 user nova-compute[75409]:   </clock>
Nov 15 21:47:15 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:47:15 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:47:15 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:47:15 user nova-compute[75409]:   </cpu>
Nov 15 21:47:15 user nova-compute[75409]:   <devices>
Nov 15 21:47:15 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:47:15 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:47:15 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:47:15 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:47:15 user nova-compute[75409]:       <serial>0de04733-3d9f-47c0-b41a-8f1e06c29131</serial>
Nov 15 21:47:15 user nova-compute[75409]:     </disk>
Nov 15 21:47:15 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:47:15 user nova-compute[75409]:       <mac address="fa:16:3e:b0:57:c4"/>
Nov 15 21:47:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:47:15 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:47:15 user nova-compute[75409]:       <target dev="tap0318c846-7c"/>
Nov 15 21:47:15 user nova-compute[75409]:     </interface>
Nov 15 21:47:15 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:47:15 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/882da7a0-cb5b-4956-984d-d9f03fb9762b/console.log" append="off"/>
Nov 15 21:47:15 user nova-compute[75409]:     </serial>
Nov 15 21:47:15 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:47:15 user nova-compute[75409]:     <video>
Nov 15 21:47:15 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:47:15 user nova-compute[75409]:     </video>
Nov 15 21:47:15 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:47:15 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:47:15 user nova-compute[75409]:     </rng>
Nov 15 21:47:15 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:47:15 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:47:15 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:47:15 user nova-compute[75409]:     </memballoon>
Nov 15 21:47:15 user nova-compute[75409]:   </devices>
Nov 15 21:47:15 user nova-compute[75409]: </domain>
Nov 15 21:47:15 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2060632717',display_name='tempest-TestVolumeBootPattern-server-2060632717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2060632717',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-uwnee7o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:47:08Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=882da7a0-cb5b-4956-984d-d9f03fb9762b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG os_vif [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d3856ea-c3c9-550d-9e2f-85add6661e83', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0318c846-7c, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0318c846-7c, col_values=(('qos', UUID('c6031623-3783-4118-ab77-ee0cd72b8712')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0318c846-7c, col_values=(('external_ids', {'iface-id': '0318c846-7c70-4708-9ad9-fe5ab5ca5aa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:57:c4', 'vm-uuid': '882da7a0-cb5b-4956-984d-d9f03fb9762b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:15 user nova-compute[75409]: INFO os_vif [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c')
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:47:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] No VIF found with MAC fa:16:3e:b0:57:c4, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] No waiting events found dispatching network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:16 user nova-compute[75409]: WARNING nova.compute.manager [req-0a0a59db-49ba-46f2-b05d-6a36af7c1447 req-dac0d8da-853b-45db-9196-8a94ffbd867b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received unexpected event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 for instance with vm_state building and task_state spawning.
Nov 15 21:47:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:17 user nova-compute[75409]: INFO nova.compute.manager [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Detaching volume 2d43b675-95c9-4d7c-8f91-5819030323e3
Nov 15 21:47:18 user nova-compute[75409]: INFO nova.virt.block_device [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Attempting to driver detach volume 2d43b675-95c9-4d7c-8f91-5819030323e3 from mountpoint /dev/vdb
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Attempting to detach device vdb from instance d69ede3d-9720-4345-8d76-28aa6d731e7d from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:47:18 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:47:18 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:47:18 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:47:18 user nova-compute[75409]:   <serial>2d43b675-95c9-4d7c-8f91-5819030323e3</serial>
Nov 15 21:47:18 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:47:18 user nova-compute[75409]: </disk>
Nov 15 21:47:18 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:47:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully detached device vdb from instance d69ede3d-9720-4345-8d76-28aa6d731e7d from the persistent domain config.
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d69ede3d-9720-4345-8d76-28aa6d731e7d from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:47:18 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:47:18 user nova-compute[75409]:   <source dev="/dev/sde"/>
Nov 15 21:47:18 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:47:18 user nova-compute[75409]:   <serial>2d43b675-95c9-4d7c-8f91-5819030323e3</serial>
Nov 15 21:47:18 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:47:18 user nova-compute[75409]: </disk>
Nov 15 21:47:18 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:47:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Instance spawned successfully.
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:47:18 user nova-compute[75409]: INFO nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] No waiting events found dispatching network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:18 user nova-compute[75409]: WARNING nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received unexpected event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 for instance with vm_state active and task_state None.
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-changed-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing instance network info cache due to event network-changed-d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:18 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing network info cache for port d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:47:18 user nova-compute[75409]: INFO nova.compute.manager [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Took 11.21 seconds to build instance.
Nov 15 21:47:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30cc7d68-3e4b-4fed-af04-138d33e935c2 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.317s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updated VIF entry in instance network info cache for port d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-changed-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing instance network info cache due to event network-changed-d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Refreshing network info cache for port d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updated VIF entry in instance network info cache for port d8004767-204a-4628-9f48-5febae9f752c. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG nova.network.neutron [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a3235f86-6554-4c01-a600-c165be4478e2 req-e01c2142-00f5-452f-b5c8-cecb9461882b service nova] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:47:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:38 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d69ede3d-9720-4345-8d76-28aa6d731e7d is timed out.
Nov 15 21:47:38 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully detached device vdb from instance d69ede3d-9720-4345-8d76-28aa6d731e7d from the live domain config.
Nov 15 21:47:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'arkSqfNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:47:38 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca22846-b3e1-4e97-bc07-b4d6fbbb6cf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:47:38 user nova-compute[75409]: No targets found.
Nov 15 21:47:38 user nova-compute[75409]: iSNS:
Nov 15 21:47:38 user nova-compute[75409]: No targets found.
Nov 15 21:47:38 user nova-compute[75409]: STATIC:
Nov 15 21:47:38 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3
Nov 15 21:47:38 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:38 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:38 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:47:38 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:38 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:38 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131
Nov 15 21:47:38 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:38 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:38 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:47:38 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:38 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:38 user nova-compute[75409]: FIRMWARE:
Nov 15 21:47:38 user nova-compute[75409]: No targets found.
Nov 15 21:47:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:47:38 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:47:38 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f826716-1f66-4f93-ade6-dbc86f3dda28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92e02a-79b0-4e4f-a165-8ba0c8e57db6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf0870d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3'): ({'sde'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Removing single pathed devices sde {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d313de-7d04-4790-8e81-c6f1a01f72c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf53c7b-eed6-41b5-bf2b-ee960526b72e]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Flushing IO for device /dev/sde {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3ddc0b-e372-4e41-9093-b285e06ca4b5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3e86b-420d-4209-9829-6961876854da]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] SCSI volumes sde have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c481f47a-8231-4cc5-9cc0-92cae40fd3aa]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7907519d-48ee-49e8-ba3e-add71e69d36e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260]
Nov 15 21:47:38 user nova-compute[75409]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3, portal: 172.16.0.220,3260] successful.
Nov 15 21:47:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d43b675-95c9-4d7c-8f91-5819030323e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba176ef2-994b-46c5-9cc7-3386f44ea90e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] <== disconnect_volume: return (304ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:47:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:47:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'flavor' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:47:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7eeaa642-c962-4193-9ea7-bba5874f2122 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:42 user nova-compute[75409]: INFO nova.compute.manager [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Terminating instance
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-052c5ae0-e0e6-4b8f-919b-2050e4d48681 req-a9cb6acf-1283-4a48-b773-7cb8dbbc1f6b service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-unplugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:47:42 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Instance destroyed successfully.
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'resources' on Instance uuid 07498a3f-f560-46db-9ac2-f466c7080d9c {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1004802004',display_name='tempest-ServerActionsTestOtherA-server-1004802004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1004802004',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-fb7tacmq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=07498a3f-f560-46db-9ac2-f466c7080d9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "address": "fa:16:3e:15:57:32", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcbe4d7-e1", "ovs_interfaceid": "0dcbe4d7-e100-44f5-97f6-a299379d2246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_vif [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcbe4d7-e1, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7081e63b-4672-46d3-91a9-d27eaa555249) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:42 user nova-compute[75409]: INFO os_vif [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:57:32,bridge_name='br-int',has_traffic_filtering=True,id=0dcbe4d7-e100-44f5-97f6-a299379d2246,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcbe4d7-e1')
Nov 15 21:47:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trwBEcju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:47:42 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a2f843-00af-4c17-8ada-07e5d5cca13a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:47:42 user nova-compute[75409]: No targets found.
Nov 15 21:47:42 user nova-compute[75409]: iSNS:
Nov 15 21:47:42 user nova-compute[75409]: No targets found.
Nov 15 21:47:42 user nova-compute[75409]: STATIC:
Nov 15 21:47:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:47:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131
Nov 15 21:47:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:42 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b
Nov 15 21:47:42 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:47:42 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:47:42 user nova-compute[75409]: FIRMWARE:
Nov 15 21:47:42 user nova-compute[75409]: No targets found.
Nov 15 21:47:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:47:42 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:47:42 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac7247-c95c-4982-943f-18af8bf9f9b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8f4077-cd32-4fd7-af9d-256fdf91c015]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:42 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:42 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b (non-flash)
Nov 15 21:47:42 user nova-compute[75409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:47:42 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:47:42 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf4816cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681c107-0654-4df8-9f2b-fb771479a80c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca80e4-4785-4a56-a381-449ce0513ffb]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbe0838-323f-4c60-8ce1-104548be5d9d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:47:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[63277515-162e-45c6-ac6b-da2e14408662]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c98c563f', '/dev/disk/by-id/scsi-1SCST_BIOc98c563f-3a6828ae0dd8b344', '/dev/disk/by-id/scsi-23361363832386165') {{(pid=86679) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca720250-1bcc-40ef-9e0d-9b2f7e66d84a]: (4, None) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f70799-967b-4f00-8493-1ffb00d1de8e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62727e-40e7-4c64-8b4b-86b6bd4ae06f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260]
Nov 15 21:47:43 user nova-compute[75409]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b, portal: 172.16.0.220,3260] successful.
Nov 15 21:47:43 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9feba7af-9dc3-4715-a55b-0ae384ab891b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d0b6c0-e9c9-4198-9a6a-c787c5077e75]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] <== disconnect_volume: return (282ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:47:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Deleting instance files /opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c_del
Nov 15 21:47:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Deletion of /opt/stack/data/nova/instances/07498a3f-f560-46db-9ac2-f466c7080d9c_del complete
Nov 15 21:47:43 user nova-compute[75409]: INFO nova.compute.manager [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 15 21:47:43 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:47:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:47:43 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Took 0.59 seconds to deallocate network for instance.
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] Acquiring lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] No waiting events found dispatching network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:47:44 user nova-compute[75409]: WARNING nova.compute.manager [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received unexpected event network-vif-plugged-0dcbe4d7-e100-44f5-97f6-a299379d2246 for instance with vm_state active and task_state deleting.
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-da382a1b-9abf-4e86-9274-cb206dd4043e req-cb04e160-8929-45a2-8d2a-f777f7031555 service nova] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Received event network-vif-deleted-0dcbe4d7-e100-44f5-97f6-a299379d2246 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:47:44 user nova-compute[75409]: INFO nova.compute.manager [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 07498a3f-f560-46db-9ac2-f466c7080d9c] Deleting volume: 9feba7af-9dc3-4715-a55b-0ae384ab891b {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:47:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:44 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Deleted allocations for instance 07498a3f-f560-46db-9ac2-f466c7080d9c
Nov 15 21:47:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d4741307-8407-49b3-b115-cea401baf961 tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "07498a3f-f560-46db-9ac2-f466c7080d9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:47:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:47:55 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:47:55 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8050MB free_disk=25.094444274902344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f3c2a748-56e5-49bb-bc58-a0fb96706fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d69ede3d-9720-4345-8d76-28aa6d731e7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e7a03aa8-3505-4d30-9929-abe6e0363e94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ddbbceaa-3054-4744-82a2-510f6f801d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 882da7a0-cb5b-4956-984d-d9f03fb9762b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:47:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:47:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:47:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:47:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [{"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d69ede3d-9720-4345-8d76-28aa6d731e7d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:48:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:08 user nova-compute[75409]: INFO nova.compute.manager [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Terminating instance
Nov 15 21:48:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e5c23e-dcba-4281-9819-485df77e2e75 req-91baab98-26d4-4f12-902d-08ca8d284f96 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-unplugged-d8004767-204a-4628-9f48-5febae9f752c for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Instance destroyed successfully.
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid d69ede3d-9720-4345-8d76-28aa6d731e7d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-500346698',display_name='tempest-ServerRescueNegativeTestJSON-server-500346698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-500346698',id=35,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESbsqe6k+BJfxjRCAjFpuLmFnEi5oy77GEeYOthZcY5F4vDxqfYdYv5F2l+z32Gs1Rc6yR9aVbYNQxfBQ5UlT814Q6EzsLAWsLmDF1wF0nIbqec0N/wfjWxiyss3cSKvw==',key_name='tempest-keypair-606468414',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-tptdfn53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=d69ede3d-9720-4345-8d76-28aa6d731e7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "d8004767-204a-4628-9f48-5febae9f752c", "address": "fa:16:3e:9e:b3:b8", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8004767-20", "ovs_interfaceid": "d8004767-204a-4628-9f48-5febae9f752c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG os_vif [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8004767-20, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b7fef5c-f200-4134-98ec-db99bc2f11ab) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: INFO os_vif [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b3:b8,bridge_name='br-int',has_traffic_filtering=True,id=d8004767-204a-4628-9f48-5febae9f752c,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8004767-20')
Nov 15 21:48:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Deleting instance files /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d_del
Nov 15 21:48:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Deletion of /opt/stack/data/nova/instances/d69ede3d-9720-4345-8d76-28aa6d731e7d_del complete
Nov 15 21:48:09 user nova-compute[75409]: INFO nova.compute.manager [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 21:48:09 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:09 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Took 0.64 seconds to deallocate network for instance.
Nov 15 21:48:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:10 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Deleted allocations for instance d69ede3d-9720-4345-8d76-28aa6d731e7d
Nov 15 21:48:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f3a73de-8c81-447b-ba57-8d55c095f9c1 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] Acquiring lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] Lock "d69ede3d-9720-4345-8d76-28aa6d731e7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] No waiting events found dispatching network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:10 user nova-compute[75409]: WARNING nova.compute.manager [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received unexpected event network-vif-plugged-d8004767-204a-4628-9f48-5febae9f752c for instance with vm_state deleted and task_state None.
Nov 15 21:48:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-98a7f805-c76d-404f-b751-41c6aeca3ac8 req-0b25f23a-b56f-4f95-a10f-7738e6dd8453 service nova] [instance: d69ede3d-9720-4345-8d76-28aa6d731e7d] Received event network-vif-deleted-d8004767-204a-4628-9f48-5febae9f752c {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:34 user nova-compute[75409]: INFO nova.compute.manager [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Terminating instance
Nov 15 21:48:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-unplugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] No waiting events found dispatching network-vif-unplugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-ef7e4ef2-6b5c-4c7c-9265-7c175b47d904 req-22d0836c-c76d-496a-b91f-256b7e31d7b4 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-unplugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:48:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Instance destroyed successfully.
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lazy-loading 'resources' on Instance uuid 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-683695795',display_name='tempest-ServerActionsTestOtherA-server-683695795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-683695795',id=19,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgp5qtQ44aJ5PTSfMdJnO83NyExuZufXptFl3HI9XoIn5Y9ShWZg7diKATtdRII7gP/vI1u1rGAAAPKTghf/grf23n5bG2A+LG45Pb+Gsh9wk5we33HcIHJVHhP8VI1CA==',key_name='tempest-keypair-1547163222',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8d130f253b745e2ac2497eebbd4cf99',ramdisk_id='',reservation_id='r-dfkuque9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1526007087',owner_user_name='tempest-ServerActionsTestOtherA-1526007087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae40e5bccb84c50a4c93963d56469f9',uuid=8f79cb9d-3fac-4e13-8f17-5d045e40ab0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converting VIF {"id": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "address": "fa:16:3e:08:c1:45", "network": {"id": "383a60eb-85d9-42cb-a60c-2c2789bb1349", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1828257159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8d130f253b745e2ac2497eebbd4cf99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5939fb-e8", "ovs_interfaceid": "3a5939fb-e818-4bad-92ee-ab635a88cff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG os_vif [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a5939fb-e8, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55830a5d-3816-478e-a9fc-621f993f342b) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:35 user nova-compute[75409]: INFO os_vif [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c1:45,bridge_name='br-int',has_traffic_filtering=True,id=3a5939fb-e818-4bad-92ee-ab635a88cff8,network=Network(383a60eb-85d9-42cb-a60c-2c2789bb1349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5939fb-e8')
Nov 15 21:48:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Deleting instance files /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e_del
Nov 15 21:48:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Deletion of /opt/stack/data/nova/instances/8f79cb9d-3fac-4e13-8f17-5d045e40ab0e_del complete
Nov 15 21:48:35 user nova-compute[75409]: INFO nova.compute.manager [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 21:48:35 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:48:35 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:36 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Took 0.40 seconds to deallocate network for instance.
Nov 15 21:48:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-c19dcf85-50fe-4bce-9da4-c9e697298679 req-6616b89d-454e-4879-b4e5-237a21cd8c69 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-deleted-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:48:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:36 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Deleted allocations for instance 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e
Nov 15 21:48:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ad77b3c7-b439-4bc6-9c1a-50fc368292ad tempest-ServerActionsTestOtherA-1526007087 tempest-ServerActionsTestOtherA-1526007087-project-member] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.652s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] Acquiring lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] Lock "8f79cb9d-3fac-4e13-8f17-5d045e40ab0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] No waiting events found dispatching network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:37 user nova-compute[75409]: WARNING nova.compute.manager [req-28b42912-de07-4af3-b9de-523d399b218a req-eb7c372d-ff8e-4518-bc8e-859c2fed1bf9 service nova] [instance: 8f79cb9d-3fac-4e13-8f17-5d045e40ab0e] Received unexpected event network-vif-plugged-3a5939fb-e818-4bad-92ee-ab635a88cff8 for instance with vm_state deleted and task_state None.
Nov 15 21:48:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:42 user nova-compute[75409]: INFO nova.compute.manager [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Terminating instance
Nov 15 21:48:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-6d4e843a-de12-4256-8099-1f4c203a5bd1 req-5b466ce5-a66e-41bd-b07d-43a4d63de459 service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-unplugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:48:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Instance destroyed successfully.
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'resources' on Instance uuid f3c2a748-56e5-49bb-bc58-a0fb96706fda {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1716788624',display_name='tempest-AttachVolumeTestJSON-server-1716788624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1716788624',id=33,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnJlUJjifYjuuOzSCCrwQYxSZ71JQm+DBCiAMRsNgNeB6OzZBFXEA71OPV+QCyFL/vlP7GYiZDWHiTECq2xgWuZ2+esVtVlj8mftJruXYU8OAg6b7+JjoLS7zuueuufyA==',key_name='tempest-keypair-1181430753',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-3eupcyuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=f3c2a748-56e5-49bb-bc58-a0fb96706fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "address": "fa:16:3e:e7:6a:61", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c482854-d2", "ovs_interfaceid": "9c482854-d245-4c9e-8092-5e046c8ea6b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG os_vif [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c482854-d2, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18f376a0-7087-4865-a476-7c20a1ae132e) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:43 user nova-compute[75409]: INFO os_vif [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6a:61,bridge_name='br-int',has_traffic_filtering=True,id=9c482854-d245-4c9e-8092-5e046c8ea6b2,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c482854-d2')
Nov 15 21:48:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Deleting instance files /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda_del
Nov 15 21:48:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Deletion of /opt/stack/data/nova/instances/f3c2a748-56e5-49bb-bc58-a0fb96706fda_del complete
Nov 15 21:48:43 user nova-compute[75409]: INFO nova.compute.manager [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 21:48:43 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:48:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:48:44 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:44 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Took 0.70 seconds to deallocate network for instance.
Nov 15 21:48:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:48:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:48:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:44 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Deleted allocations for instance f3c2a748-56e5-49bb-bc58-a0fb96706fda
Nov 15 21:48:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d276df0-3c68-4714-bcaa-d4eaf5038952 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] Acquiring lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] Lock "f3c2a748-56e5-49bb-bc58-a0fb96706fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] No waiting events found dispatching network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:48:45 user nova-compute[75409]: WARNING nova.compute.manager [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received unexpected event network-vif-plugged-9c482854-d245-4c9e-8092-5e046c8ea6b2 for instance with vm_state deleted and task_state None.
Nov 15 21:48:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-d7fecef3-460c-423e-b88d-7ca83d1e7a81 req-715bef3a-50de-4bb4-9959-39ad665f397e service nova] [instance: f3c2a748-56e5-49bb-bc58-a0fb96706fda] Received event network-vif-deleted-9c482854-d245-4c9e-8092-5e046c8ea6b2 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-changed-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Refreshing instance network info cache due to event network-changed-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:48:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] Acquiring lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:48:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] Acquired lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:48:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Refreshing network info cache for port c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:48:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updated VIF entry in instance network info cache for port c8292ca7-c7fa-4e7d-9da0-073b8ee675a9. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:48:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updating instance_info_cache with network_info: [{"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-32cfd8c9-a467-4080-a2a4-434cc1f9e761 req-161d78db-18ae-4b42-9901-2c79eb595521 service nova] Releasing lock "refresh_cache-ddbbceaa-3054-4744-82a2-510f6f801d4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:48:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:50 user nova-compute[75409]: INFO nova.compute.manager [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Attaching volume 0df7614d-e540-4819-854d-ff0e9afdc95c to /dev/vdb
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c446ee-a9fb-4603-89d6-92dff8ea55c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33969ff0-b11a-4d56-aec9-00ff9aa50cb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42afcd66-72ac-4620-9aaf-98785e7796e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c68879-e9e7-425f-9b8a-46f607ed9f87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:48:50 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:48:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c78b414-ff0d-4ea8-a8dd-4b88d3d53371]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:48:50 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updating existing volume attachment record: 75f03eb8-2307-48e2-b062-f6d4abb29e11 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:48:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:48:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:48:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtQmdyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:48:55 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:48:55 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:48:55 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea43f269-4aae-4934-aff4-a5312c25948c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:48:55 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb496d10-facd-4f88-a0f7-14aab46c964b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c] added
Nov 15 21:48:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f71e8b-58a2-411a-aa45-2a0debbb69f7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef112bc-2b36-4d98-b167-a0c9b6f41973]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqtQmdyN {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqtQmdyN" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a0d0a-de21-4520-9bf1-c54c51d62f72]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AqtQmdyN'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d10753-62a4-493e-9a92-352074e1ad07]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd28b38a-b67f-4e73-845d-d0da10afd1df]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:48:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=25.177265167236328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04a485-252b-4bfe-b653-6d407e0e1476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260]
Nov 15 21:48:56 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260] successful.
Nov 15 21:48:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf8c449-a85f-4eee-9c1c-8f28d167b5a9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e7a03aa8-3505-4d30-9929-abe6e0363e94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance ddbbceaa-3054-4744-82a2-510f6f801d4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 882da7a0-cb5b-4956-984d-d9f03fb9762b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba48b96-5767-4b1c-8e5e-655021553f6e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:48:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:48:56 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:48:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.633s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e397bbf4-74b4-489f-a271-307b9795df98]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtQmdyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:48:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.667s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== connect_volume: return (1670ms) {'type': 'block', 'scsi_wwn': '26461346633656632', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461346633656632', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:48:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:48:57 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:48:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:48:57 user nova-compute[75409]:   <serial>0df7614d-e540-4819-854d-ff0e9afdc95c</serial>
Nov 15 21:48:57 user nova-compute[75409]: </disk>
Nov 15 21:48:57 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] No VIF found with MAC fa:16:3e:0d:50:9b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:48:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a4e274e3-ecd4-4484-be62-b07ddf0028f0 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.156s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:48:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:48:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:48:58 user nova-compute[75409]: INFO nova.compute.manager [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Detaching volume 0df7614d-e540-4819-854d-ff0e9afdc95c
Nov 15 21:48:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:48:58 user nova-compute[75409]: INFO nova.virt.block_device [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Attempting to driver detach volume 0df7614d-e540-4819-854d-ff0e9afdc95c from mountpoint /dev/vdb
Nov 15 21:48:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Attempting to detach device vdb from instance ddbbceaa-3054-4744-82a2-510f6f801d4b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:48:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:48:58 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:48:58 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:48:58 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:48:58 user nova-compute[75409]:   <serial>0df7614d-e540-4819-854d-ff0e9afdc95c</serial>
Nov 15 21:48:58 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:48:58 user nova-compute[75409]: </disk>
Nov 15 21:48:58 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:48:58 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance ddbbceaa-3054-4744-82a2-510f6f801d4b from the persistent domain config.
Nov 15 21:48:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddbbceaa-3054-4744-82a2-510f6f801d4b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:48:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:48:58 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:48:58 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:48:58 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:48:58 user nova-compute[75409]:   <serial>0df7614d-e540-4819-854d-ff0e9afdc95c</serial>
Nov 15 21:48:58 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:48:58 user nova-compute[75409]: </disk>
Nov 15 21:48:58 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing instance network info cache due to event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] Acquiring lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] Acquired lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updated VIF entry in instance network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating instance_info_cache with network_info: [{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:48:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-dcdd92a2-2fee-45a9-9136-7456e63d2940 req-7816d15b-47cb-4014-aa41-f867b0c3c2f1 service nova] Releasing lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing instance network info cache due to event network-changed-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] Acquiring lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] Acquired lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG nova.network.neutron [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Refreshing network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:00 user nova-compute[75409]: INFO nova.compute.manager [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Terminating instance
Nov 15 21:49:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updated VIF entry in instance network info cache for port 0318c846-7c70-4708-9ad9-fe5ab5ca5aa5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating instance_info_cache with network_info: [{"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d6ee8368-a67a-4b0c-9bee-6a464cb1aadd req-4c1836c7-d876-4fa4-9e8f-bda5e285ec09 service nova] Releasing lock "refresh_cache-882da7a0-cb5b-4956-984d-d9f03fb9762b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Instance destroyed successfully.
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.objects.instance [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid 882da7a0-cb5b-4956-984d-d9f03fb9762b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2060632717',display_name='tempest-TestVolumeBootPattern-server-2060632717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2060632717',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:47:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-uwnee7o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:47:19Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=882da7a0-cb5b-4956-984d-d9f03fb9762b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "address": "fa:16:3e:b0:57:c4", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318c846-7c", "ovs_interfaceid": "0318c846-7c70-4708-9ad9-fe5ab5ca5aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_vif [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0318c846-7c, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6031623-3783-4118-ab77-ee0cd72b8712) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:01 user nova-compute[75409]: INFO os_vif [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:57:c4,bridge_name='br-int',has_traffic_filtering=True,id=0318c846-7c70-4708-9ad9-fe5ab5ca5aa5,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318c846-7c')
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwDxXIQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:49:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd9c0da-337b-4682-9644-898d90d92e83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:49:01 user nova-compute[75409]: No targets found.
Nov 15 21:49:01 user nova-compute[75409]: iSNS:
Nov 15 21:49:01 user nova-compute[75409]: No targets found.
Nov 15 21:49:01 user nova-compute[75409]: STATIC:
Nov 15 21:49:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c
Nov 15 21:49:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:49:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:01 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131
Nov 15 21:49:01 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:01 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:01 user nova-compute[75409]: FIRMWARE:
Nov 15 21:49:01 user nova-compute[75409]: No targets found.
Nov 15 21:49:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:49:01 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:49:01 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d8260-30b6-4672-94d1-43092d8ea90a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aad818-f62f-4fa5-b019-85a370d123a1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:01 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:49:01 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:49:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:01 user nova-compute[75409]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 (non-flash)
Nov 15 21:49:01 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:49:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf08798670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90698871-4dd4-4c4b-8269-7086a5bc08a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9163cb-48f9-4afa-bbb8-f0e4c513b5b0]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2c36a1-7280-45aa-8296-26b3ea4f8e95]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5794825c-b505-4982-bd5e-75999973f88a]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d889b4-3e9e-42fc-974e-16dc14db6387]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49d905-873e-43b4-92fe-d213c1fd5399]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260]
Nov 15 21:49:01 user nova-compute[75409]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131, portal: 172.16.0.220,3260] successful.
Nov 15 21:49:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de04733-3d9f-47c0-b41a-8f1e06c29131 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc4ee1-37e3-461b-acc2-a91d2894c4df]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (302ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:49:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Deleting instance files /opt/stack/data/nova/instances/882da7a0-cb5b-4956-984d-d9f03fb9762b_del
Nov 15 21:49:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Deletion of /opt/stack/data/nova/instances/882da7a0-cb5b-4956-984d-d9f03fb9762b_del complete
Nov 15 21:49:01 user nova-compute[75409]: INFO nova.compute.manager [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 21:49:01 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:49:01 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-unplugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] No waiting events found dispatching network-vif-unplugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-unplugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Acquiring lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] No waiting events found dispatching network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:02 user nova-compute[75409]: WARNING nova.compute.manager [req-1efec61f-78a7-483c-9afa-0fa239e00b8b req-219bc16f-acb9-4b5a-84fe-bf31b2363fd3 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received unexpected event network-vif-plugged-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 for instance with vm_state active and task_state deleting.
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:02 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Took 0.46 seconds to deallocate network for instance.
Nov 15 21:49:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-d9d5609c-1090-4d93-be7d-4bd6489ecbe6 req-54ae434f-7998-463d-bdf8-d7c88b9707e1 service nova] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Received event network-vif-deleted-0318c846-7c70-4708-9ad9-fe5ab5ca5aa5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.compute.manager [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Terminating instance
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.compute.manager [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: 882da7a0-cb5b-4956-984d-d9f03fb9762b] Took 1.89 seconds to detach 1 volumes for instance.
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-ca2734b3-6396-48b2-9a13-dae02e220642 req-672391ba-76e5-4a3c-bddf-e99192702bbc service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-unplugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance 882da7a0-cb5b-4956-984d-d9f03fb9762b
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fb0e1d31-dd7d-4ce0-bb88-b123c86a9234 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "882da7a0-cb5b-4956-984d-d9f03fb9762b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.986s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Instance destroyed successfully.
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid dc80da1c-5f06-44c8-bf8b-2406c22b9d73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1141366530',display_name='tempest-ServerRescueNegativeTestJSON-server-1141366530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1141366530',id=25,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:34:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-x7wx0rvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:34:59Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=dc80da1c-5f06-44c8-bf8b-2406c22b9d73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "address": "fa:16:3e:92:6a:62", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896cbe20-15", "ovs_interfaceid": "896cbe20-15ce-4be9-9b16-c08d3d92a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG os_vif [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896cbe20-15, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cebc8b83-52ca-49a9-9803-e45b0f77cd09) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:04 user nova-compute[75409]: INFO os_vif [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6a:62,bridge_name='br-int',has_traffic_filtering=True,id=896cbe20-15ce-4be9-9b16-c08d3d92a70b,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896cbe20-15')
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Deleting instance files /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73_del
Nov 15 21:49:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Deletion of /opt/stack/data/nova/instances/dc80da1c-5f06-44c8-bf8b-2406c22b9d73_del complete
Nov 15 21:49:05 user nova-compute[75409]: INFO nova.compute.manager [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 21:49:05 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:05 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Took 0.44 seconds to deallocate network for instance.
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-2e9aa4f6-6579-4da4-9a55-bb19a52374f4 req-45da0137-c1c9-41ea-92bf-7ed5a614ed8f service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-deleted-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:05 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Deleted allocations for instance dc80da1c-5f06-44c8-bf8b-2406c22b9d73
Nov 15 21:49:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b390a67c-3d92-4be8-9983-410ec1c76fd6 tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] Acquiring lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] Lock "dc80da1c-5f06-44c8-bf8b-2406c22b9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:06 user nova-compute[75409]: DEBUG nova.compute.manager [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] No waiting events found dispatching network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:06 user nova-compute[75409]: WARNING nova.compute.manager [req-6f3e3697-74ff-4f60-b990-c628f426451b req-4813d1fa-48f8-4582-8e3b-ef6312b39be0 service nova] [instance: dc80da1c-5f06-44c8-bf8b-2406c22b9d73] Received unexpected event network-vif-plugged-896cbe20-15ce-4be9-9b16-c08d3d92a70b for instance with vm_state deleted and task_state None.
Nov 15 21:49:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddbbceaa-3054-4744-82a2-510f6f801d4b is timed out.
Nov 15 21:49:19 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully detached device vdb from instance ddbbceaa-3054-4744-82a2-510f6f801d4b from the live domain config.
Nov 15 21:49:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqtQmdyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:49:19 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f333feb-dde1-4880-bbda-d72c9340bc54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:49:19 user nova-compute[75409]: No targets found.
Nov 15 21:49:19 user nova-compute[75409]: iSNS:
Nov 15 21:49:19 user nova-compute[75409]: No targets found.
Nov 15 21:49:19 user nova-compute[75409]: STATIC:
Nov 15 21:49:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c
Nov 15 21:49:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:49:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:19 user nova-compute[75409]: FIRMWARE:
Nov 15 21:49:19 user nova-compute[75409]: No targets found.
Nov 15 21:49:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:49:19 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:49:19 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d390132c-601a-42d8-aabb-f65c0a9198a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee11dbf7-cf65-4860-bd6e-6f27aa906105]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:19 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:49:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:19 user nova-compute[75409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c (non-flash)
Nov 15 21:49:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281cfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f812e-3122-4140-a625-6bdd02f49786]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ba5e73-a380-4ffb-b0b8-6e6519fda0f6]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbf36b-3064-4a2a-a863-1530c06240ec]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8ef127-01c7-41f1-bc50-5f92a50839a2]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c33ed-e2ed-46d2-ac26-61d7f77b554f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1943400a-11a0-4395-b7fd-c5471a044a3e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260]
Nov 15 21:49:19 user nova-compute[75409]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c, portal: 172.16.0.220,3260] successful.
Nov 15 21:49:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df7614d-e540-4819-854d-ff0e9afdc95c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56033144-99ec-429b-bf68-8ad56d3ae85a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] <== disconnect_volume: return (292ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:49:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:20 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'flavor' on Instance uuid ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d6449024-8edc-4efc-ba72-aab3a82592e2 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:36 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:49:36 user nova-compute[75409]: INFO nova.compute.claims [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Claim successful on node user
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:49:37 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:49:37 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Creating image(s)
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "/opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "/opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.policy [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e867fa9de5b345518d1e7bea923f8e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbce891b648d4fa299edae25edf1965a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk 1073741824" returned: 0 in 0.052s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:37 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Successfully created port: 1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Cannot resize image /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Ensure instance console log exists: /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Successfully updated port: 1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquired lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-changed-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Refreshing instance network info cache due to event network-changed-1ebfaa8b-7541-44e0-9a40-5a55af818539. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] Acquiring lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Releasing lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Instance network_info: |[{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] Acquired lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.neutron [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Refreshing network info cache for port 1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Start _get_guest_xml network_info=[{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:49:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2124732781',display_name='tempest-AttachVolumeTestJSON-server-2124732781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2124732781',id=41,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq7O94KUrCYRRP84rVbsaT/vu/YKiqRjRVsNNaUBPBh89ljN7NT6dw/dvAasWXgG+osxedUDQhy6bwYhum7S1ZSEQG0msalBsxPK/ZOSMi6yBmvhxyohA8w8g2n1W1MnQ==',key_name='tempest-keypair-2129585454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-e6f3jydi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=b9fbb579-5374-443f-82d7-7355c0afca1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'pci_devices' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:49:39 user nova-compute[75409]:   <uuid>b9fbb579-5374-443f-82d7-7355c0afca1b</uuid>
Nov 15 21:49:39 user nova-compute[75409]:   <name>instance-00000029</name>
Nov 15 21:49:39 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:49:39 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:49:39 user nova-compute[75409]:   <metadata>
Nov 15 21:49:39 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:49:39 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:name>tempest-AttachVolumeTestJSON-server-2124732781</nova:name>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:49:39</nova:creationTime>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:49:39 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:49:39 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:owner>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:user uuid="e867fa9de5b345518d1e7bea923f8e55">tempest-AttachVolumeTestJSON-753726309-project-member</nova:user>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:project uuid="fbce891b648d4fa299edae25edf1965a">tempest-AttachVolumeTestJSON-753726309</nova:project>
Nov 15 21:49:39 user nova-compute[75409]:       </nova:owner>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:49:39 user nova-compute[75409]:       <nova:ports>
Nov 15 21:49:39 user nova-compute[75409]:         <nova:port uuid="1ebfaa8b-7541-44e0-9a40-5a55af818539">
Nov 15 21:49:39 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 21:49:39 user nova-compute[75409]:         </nova:port>
Nov 15 21:49:39 user nova-compute[75409]:       </nova:ports>
Nov 15 21:49:39 user nova-compute[75409]:     </nova:instance>
Nov 15 21:49:39 user nova-compute[75409]:   </metadata>
Nov 15 21:49:39 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:49:39 user nova-compute[75409]:     <system>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="serial">b9fbb579-5374-443f-82d7-7355c0afca1b</entry>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="uuid">b9fbb579-5374-443f-82d7-7355c0afca1b</entry>
Nov 15 21:49:39 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:49:39 user nova-compute[75409]:     </system>
Nov 15 21:49:39 user nova-compute[75409]:   </sysinfo>
Nov 15 21:49:39 user nova-compute[75409]:   <os>
Nov 15 21:49:39 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:49:39 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:49:39 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:49:39 user nova-compute[75409]:   </os>
Nov 15 21:49:39 user nova-compute[75409]:   <features>
Nov 15 21:49:39 user nova-compute[75409]:     <acpi/>
Nov 15 21:49:39 user nova-compute[75409]:     <apic/>
Nov 15 21:49:39 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:49:39 user nova-compute[75409]:   </features>
Nov 15 21:49:39 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:49:39 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:49:39 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:49:39 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:49:39 user nova-compute[75409]:   </clock>
Nov 15 21:49:39 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:49:39 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:49:39 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:49:39 user nova-compute[75409]:   </cpu>
Nov 15 21:49:39 user nova-compute[75409]:   <devices>
Nov 15 21:49:39 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:49:39 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:49:39 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk"/>
Nov 15 21:49:39 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:49:39 user nova-compute[75409]:     </disk>
Nov 15 21:49:39 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:49:39 user nova-compute[75409]:       <mac address="fa:16:3e:b9:07:f7"/>
Nov 15 21:49:39 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:49:39 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:49:39 user nova-compute[75409]:       <target dev="tap1ebfaa8b-75"/>
Nov 15 21:49:39 user nova-compute[75409]:     </interface>
Nov 15 21:49:39 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:49:39 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/console.log" append="off"/>
Nov 15 21:49:39 user nova-compute[75409]:     </serial>
Nov 15 21:49:39 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:49:39 user nova-compute[75409]:     <video>
Nov 15 21:49:39 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:49:39 user nova-compute[75409]:     </video>
Nov 15 21:49:39 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:49:39 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:49:39 user nova-compute[75409]:     </rng>
Nov 15 21:49:39 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:49:39 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:49:39 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:49:39 user nova-compute[75409]:     </memballoon>
Nov 15 21:49:39 user nova-compute[75409]:   </devices>
Nov 15 21:49:39 user nova-compute[75409]: </domain>
Nov 15 21:49:39 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2124732781',display_name='tempest-AttachVolumeTestJSON-server-2124732781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2124732781',id=41,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq7O94KUrCYRRP84rVbsaT/vu/YKiqRjRVsNNaUBPBh89ljN7NT6dw/dvAasWXgG+osxedUDQhy6bwYhum7S1ZSEQG0msalBsxPK/ZOSMi6yBmvhxyohA8w8g2n1W1MnQ==',key_name='tempest-keypair-2129585454',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-e6f3jydi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=b9fbb579-5374-443f-82d7-7355c0afca1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG os_vif [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a508c0d1-2d83-546f-a07c-ca66ecffc6d9', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ebfaa8b-75, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ebfaa8b-75, col_values=(('qos', UUID('9067f47c-2403-4204-a55d-8918a62ab625')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ebfaa8b-75, col_values=(('external_ids', {'iface-id': '1ebfaa8b-7541-44e0-9a40-5a55af818539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:07:f7', 'vm-uuid': 'b9fbb579-5374-443f-82d7-7355c0afca1b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:39 user nova-compute[75409]: INFO os_vif [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75')
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No VIF found with MAC fa:16:3e:b9:07:f7, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.neutron [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updated VIF entry in instance network info cache for port 1ebfaa8b-7541-44e0-9a40-5a55af818539. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG nova.network.neutron [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3f7f19ff-983c-4741-937f-00a28cbbd209 req-d963febe-ccba-429d-91d3-a925352107e5 service nova] Releasing lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] No waiting events found dispatching network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:41 user nova-compute[75409]: WARNING nova.compute.manager [req-5562c24e-4d2b-4cf4-9d1c-3cc943120ff9 req-6c9cf9d2-a67f-41b8-b78b-2d6f43946c8c service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received unexpected event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 for instance with vm_state building and task_state spawning.
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:49:42 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Instance spawned successfully.
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:42 user nova-compute[75409]: INFO nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:42 user nova-compute[75409]: INFO nova.compute.manager [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Took 5.99 seconds to build instance.
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b3c2ff8-5b02-4865-a295-107f61089688 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.090s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:42 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:49:42 user nova-compute[75409]: INFO nova.compute.claims [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Claim successful on node user
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:49:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.policy [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9289b2808c224505bc96a2a918273e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b807bbf75d46739469d0e656d3333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:49:43 user nova-compute[75409]: INFO nova.virt.block_device [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Booting with volume 0a35bb87-928f-4086-9332-1b1b39883ce3 at /dev/vda
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.utils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a9556f-4950-4932-8aa5-1338bd77131c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74096ecc-f90d-4704-a20e-b15c3707a5c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[566f6ff1-9e28-4ddc-890d-fb3badf1537b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a049be3-d3e7-43f8-a153-cb52ab2dec88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:49:43 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[45355377-c898-45fb-aefd-327c7c422246]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG os_brick.utils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating existing volume attachment record: 2568b8c8-0b81-4712-9351-a6b6d5d0329c {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] No waiting events found dispatching network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:43 user nova-compute[75409]: WARNING nova.compute.manager [req-d9adec12-db3c-4922-af15-4721cca5572b req-29413db4-0c0e-4f29-8811-09af1c6e4699 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received unexpected event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 for instance with vm_state active and task_state None.
Nov 15 21:49:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Successfully created port: 1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Successfully updated port: 1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquired lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating instance_info_cache with network_info: [{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Releasing lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance network_info: |[{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-changed-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Refreshing instance network info cache due to event network-changed-1e58467f-4bcc-4d98-8571-dab8acdadabd. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] Acquiring lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] Acquired lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Refreshing network info cache for port 1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updated VIF entry in instance network info cache for port 1e58467f-4bcc-4d98-8571-dab8acdadabd. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG nova.network.neutron [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating instance_info_cache with network_info: [{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7ce6061e-0e30-4fed-88e6-e1644d3ffcb0 req-80d5bc40-6081-4743-9fca-0c28916f5515 service nova] Releasing lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:49:48 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Creating image(s)
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Ensure instance console log exists: /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start _get_guest_xml network_info=[{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01f60e28-1c2b-4764-a0c4-bd6e323d652d', 'attached_at': '', 'detached_at': '', 'volume_id': '0a35bb87-928f-4086-9332-1b1b39883ce3', 'serial': '0a35bb87-928f-4086-9332-1b1b39883ce3'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '2568b8c8-0b81-4712-9351-a6b6d5d0329c', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:49:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:49:48 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:49:48 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:49:48 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d20eea-8bd5-4b76-b7ee-6f5908d12fa1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:49:48 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5c2d0-d601-4407-846f-cdec0eb4b522]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3] added
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9da0d60-121a-4bdf-a85f-a41e6344f53e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e39a346-9724-4abe-8b18-8a38155c23a7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfmNEYoX {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfmNEYoX" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec35b46-60b4-47df-a078-2156b6b83859]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfmNEYoX'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf35345-5361-4f32-8e30-fa21c6e0aa3c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba152d-f636-4117-84cd-f56aabf95284]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b7bd7-772a-4e7d-8476-1e981bd79f69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]
Nov 15 21:49:48 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1138cfc4-e576-47d1-8759-0918907c8f3d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:48 user nova-compute[75409]: INFO nova.compute.manager [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Terminating instance
Nov 15 21:49:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23652ff3-3c29-44e9-950e-08d754185ad3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:49:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:49:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9019f26d-4aff-4195-a45e-d68cc8d75f38]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-unplugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] No waiting events found dispatching network-vif-unplugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-a6898efb-772b-4d35-be97-f68fa0766d27 req-17bb3de5-ba2a-485a-a515-1b3669936c86 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-unplugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Instance destroyed successfully.
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lazy-loading 'resources' on Instance uuid ddbbceaa-3054-4744-82a2-510f6f801d4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110545822',display_name='tempest-AttachVolumeNegativeTest-server-2110545822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110545822',id=39,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7O7NnqpL0rtEVIhiQA0JlNlPF5FIr2dnfa09Hu0e4pzevXIoHkJmlXkFKSMQ/A50gF5hGhwudkj94AgzqOZhhD5E0G0RF8L16kRfrPDI0kuHQKbzIbrhxWpAAzI4XukA==',key_name='tempest-keypair-1353848472',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45d9e1e2556e4ec396ccabb7f7126bf0',ramdisk_id='',reservation_id='r-mt413rtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1984244406',owner_user_name='tempest-AttachVolumeNegativeTest-1984244406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:47:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='752b5dc398bb45608817b61c4ccbfb8b',uuid=ddbbceaa-3054-4744-82a2-510f6f801d4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converting VIF {"id": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "address": "fa:16:3e:0d:50:9b", "network": {"id": "4b476d17-c8ac-460b-95e7-1e245a990926", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-332799503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45d9e1e2556e4ec396ccabb7f7126bf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8292ca7-c7", "ovs_interfaceid": "c8292ca7-c7fa-4e7d-9da0-073b8ee675a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG os_vif [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8292ca7-c7, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04255254-0176-4b08-a56b-d43a6f443d13) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:49 user nova-compute[75409]: INFO os_vif [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=c8292ca7-c7fa-4e7d-9da0-073b8ee675a9,network=Network(4b476d17-c8ac-460b-95e7-1e245a990926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8292ca7-c7')
Nov 15 21:49:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Deleting instance files /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b_del
Nov 15 21:49:49 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Deletion of /opt/stack/data/nova/instances/ddbbceaa-3054-4744-82a2-510f6f801d4b_del complete
Nov 15 21:49:49 user nova-compute[75409]: INFO nova.compute.manager [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 21:49:49 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:49:49 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23734383564626331', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383564626331', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-892175260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f60e28-1c2b-4764-a0c4-bd6e323d652d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:49:50 user nova-compute[75409]:   <uuid>01f60e28-1c2b-4764-a0c4-bd6e323d652d</uuid>
Nov 15 21:49:50 user nova-compute[75409]:   <name>instance-0000002a</name>
Nov 15 21:49:50 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:49:50 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:49:50 user nova-compute[75409]:   <metadata>
Nov 15 21:49:50 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:49:50 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:49:50 user nova-compute[75409]:       <nova:name>tempest-ServerActionsV293TestJSON-server-892175260</nova:name>
Nov 15 21:49:50 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:49:48</nova:creationTime>
Nov 15 21:49:50 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:49:50 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:49:50 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:49:50 user nova-compute[75409]:       <nova:owner>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:user uuid="9289b2808c224505bc96a2a918273e70">tempest-ServerActionsV293TestJSON-1776681446-project-member</nova:user>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:project uuid="47b807bbf75d46739469d0e656d3333d">tempest-ServerActionsV293TestJSON-1776681446</nova:project>
Nov 15 21:49:50 user nova-compute[75409]:       </nova:owner>
Nov 15 21:49:50 user nova-compute[75409]:       <nova:ports>
Nov 15 21:49:50 user nova-compute[75409]:         <nova:port uuid="1e58467f-4bcc-4d98-8571-dab8acdadabd">
Nov 15 21:49:50 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:49:50 user nova-compute[75409]:         </nova:port>
Nov 15 21:49:50 user nova-compute[75409]:       </nova:ports>
Nov 15 21:49:50 user nova-compute[75409]:     </nova:instance>
Nov 15 21:49:50 user nova-compute[75409]:   </metadata>
Nov 15 21:49:50 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:49:50 user nova-compute[75409]:     <system>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="serial">01f60e28-1c2b-4764-a0c4-bd6e323d652d</entry>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="uuid">01f60e28-1c2b-4764-a0c4-bd6e323d652d</entry>
Nov 15 21:49:50 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:49:50 user nova-compute[75409]:     </system>
Nov 15 21:49:50 user nova-compute[75409]:   </sysinfo>
Nov 15 21:49:50 user nova-compute[75409]:   <os>
Nov 15 21:49:50 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:49:50 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:49:50 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:49:50 user nova-compute[75409]:   </os>
Nov 15 21:49:50 user nova-compute[75409]:   <features>
Nov 15 21:49:50 user nova-compute[75409]:     <acpi/>
Nov 15 21:49:50 user nova-compute[75409]:     <apic/>
Nov 15 21:49:50 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:49:50 user nova-compute[75409]:   </features>
Nov 15 21:49:50 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:49:50 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:49:50 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:49:50 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:49:50 user nova-compute[75409]:   </clock>
Nov 15 21:49:50 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:49:50 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:49:50 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:49:50 user nova-compute[75409]:   </cpu>
Nov 15 21:49:50 user nova-compute[75409]:   <devices>
Nov 15 21:49:50 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:49:50 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:49:50 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:49:50 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:49:50 user nova-compute[75409]:       <serial>0a35bb87-928f-4086-9332-1b1b39883ce3</serial>
Nov 15 21:49:50 user nova-compute[75409]:     </disk>
Nov 15 21:49:50 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:49:50 user nova-compute[75409]:       <mac address="fa:16:3e:6c:4b:54"/>
Nov 15 21:49:50 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:49:50 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:49:50 user nova-compute[75409]:       <target dev="tap1e58467f-4b"/>
Nov 15 21:49:50 user nova-compute[75409]:     </interface>
Nov 15 21:49:50 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:49:50 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d/console.log" append="off"/>
Nov 15 21:49:50 user nova-compute[75409]:     </serial>
Nov 15 21:49:50 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:49:50 user nova-compute[75409]:     <video>
Nov 15 21:49:50 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:49:50 user nova-compute[75409]:     </video>
Nov 15 21:49:50 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:49:50 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:49:50 user nova-compute[75409]:     </rng>
Nov 15 21:49:50 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:49:50 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:49:50 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:49:50 user nova-compute[75409]:     </memballoon>
Nov 15 21:49:50 user nova-compute[75409]:   </devices>
Nov 15 21:49:50 user nova-compute[75409]: </domain>
Nov 15 21:49:50 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-892175260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG os_vif [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21ed69d4-2917-550e-ba28-e9f8c4ace85a', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e58467f-4b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e58467f-4b, col_values=(('qos', UUID('06d9706e-e349-405e-8739-ca9639fa9597')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e58467f-4b, col_values=(('external_ids', {'iface-id': '1e58467f-4bcc-4d98-8571-dab8acdadabd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:4b:54', 'vm-uuid': '01f60e28-1c2b-4764-a0c4-bd6e323d652d'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:50 user nova-compute[75409]: INFO os_vif [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b')
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] No VIF found with MAC fa:16:3e:6c:4b:54, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:50 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Took 0.74 seconds to deallocate network for instance.
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-f3cf1ba0-b6f8-4afa-8c54-bdb1a92ad0e2 req-fecbb794-2781-4cd8-91be-7fec6bab4923 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-deleted-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:50 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Deleted allocations for instance ddbbceaa-3054-4744-82a2-510f6f801d4b
Nov 15 21:49:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-918445ff-3b20-43c7-9116-2bd0d1d38574 tempest-AttachVolumeNegativeTest-1984244406 tempest-AttachVolumeNegativeTest-1984244406-project-member] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] Acquiring lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] Lock "ddbbceaa-3054-4744-82a2-510f6f801d4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] No waiting events found dispatching network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:51 user nova-compute[75409]: WARNING nova.compute.manager [req-05554a60-86e3-435e-a8c4-51f8a43fe132 req-c40c270c-ea3b-43d1-8b6f-f3b7d8eec831 service nova] [instance: ddbbceaa-3054-4744-82a2-510f6f801d4b] Received unexpected event network-vif-plugged-c8292ca7-c7fa-4e7d-9da0-073b8ee675a9 for instance with vm_state deleted and task_state None.
Nov 15 21:49:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:52 user nova-compute[75409]: WARNING nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state building and task_state spawning.
Nov 15 21:49:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:52 user nova-compute[75409]: WARNING nova.compute.manager [req-38590578-2f15-4534-9298-b34ac8acba3c req-474cf21f-8919-42e5-918b-18bd4b813891 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state building and task_state spawning.
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:49:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance spawned successfully.
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:49:53 user nova-compute[75409]: INFO nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 15 21:49:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:49:53 user nova-compute[75409]: INFO nova.compute.manager [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Took 11.13 seconds to build instance.
Nov 15 21:49:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0cf5908b-146b-4c6a-8429-ac6df77cdf86 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.228s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:54 user nova-compute[75409]: INFO nova.compute.manager [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Terminating instance
Nov 15 21:49:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:49:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-14520587-d1db-437a-ae7e-f9483cf96437 req-5f32777c-ed3d-4cdb-aba2-74f8b9af9c44 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-unplugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Instance destroyed successfully.
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lazy-loading 'resources' on Instance uuid 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578225289',display_name='tempest-ServerRescueNegativeTestJSON-server-578225289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578225289',id=24,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87098be8776c4e46abb1354048e23db4',ramdisk_id='',reservation_id='r-cx08850c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1998844296',owner_user_name='tempest-ServerRescueNegativeTestJSON-1998844296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:39:43Z,user_data=None,user_id='5cc4ebbfd85c43b78157cd50d8d4ef24',uuid=270fd5bf-1d83-42f3-80b9-b92a5f29fcbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converting VIF {"id": "c3ccfd5c-9505-4387-b41c-b782d3722549", "address": "fa:16:3e:a9:23:6b", "network": {"id": "4aabcca6-db78-4013-be88-d02cd25907b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-69979406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87098be8776c4e46abb1354048e23db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3ccfd5c-95", "ovs_interfaceid": "c3ccfd5c-9505-4387-b41c-b782d3722549", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG os_vif [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3ccfd5c-95, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36f6fe69-ed1e-4a1e-acf9-0c1917e4152e) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:55 user nova-compute[75409]: INFO os_vif [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:23:6b,bridge_name='br-int',has_traffic_filtering=True,id=c3ccfd5c-9505-4387-b41c-b782d3722549,network=Network(4aabcca6-db78-4013-be88-d02cd25907b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3ccfd5c-95')
Nov 15 21:49:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Deleting instance files /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd_del
Nov 15 21:49:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Deletion of /opt/stack/data/nova/instances/270fd5bf-1d83-42f3-80b9-b92a5f29fcbd_del complete
Nov 15 21:49:55 user nova-compute[75409]: INFO nova.compute.manager [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 21:49:55 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:49:55 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing instance network info cache due to event network-changed-0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] Acquiring lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] Acquired lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.network.neutron [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Refreshing network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:56 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Took 0.60 seconds to deallocate network for instance.
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:56 user nova-compute[75409]: INFO nova.compute.manager [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Terminating instance
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.006s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:56 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:49:57 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Deleted allocations for instance 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Acquiring lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] No waiting events found dispatching network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:57 user nova-compute[75409]: WARNING nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received unexpected event network-vif-plugged-c3ccfd5c-9505-4387-b41c-b782d3722549 for instance with vm_state deleted and task_state None.
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: 270fd5bf-1d83-42f3-80b9-b92a5f29fcbd] Received event network-vif-deleted-c3ccfd5c-9505-4387-b41c-b782d3722549 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-unplugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] No waiting events found dispatching network-vif-unplugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-unplugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Acquiring lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] No waiting events found dispatching network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:49:57 user nova-compute[75409]: WARNING nova.compute.manager [req-40f0df3f-5e35-4e44-90a4-7f61f9f68517 req-d000b8af-b0d1-446f-b91e-bad9774147b9 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received unexpected event network-vif-plugged-0ef3bfa3-afab-4d95-8771-c43422f2ee82 for instance with vm_state active and task_state deleting.
Nov 15 21:49:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Instance destroyed successfully.
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lazy-loading 'resources' on Instance uuid e7a03aa8-3505-4d30-9929-abe6e0363e94 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:49:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.248756408691406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-425373142',display_name='tempest-TestVolumeBootPattern-server-425373142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-425373142',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGMQqKYx278tG74ipkJlly2P3x7HLSwX8pN/r3EJd71rtFhGpAYp4pX+YCWqPwaLVGOopnMZtYalS1VWaMsjCUapAlhw2sX6a9J17vSlDIVpdNb85rEUexaoKPubvQcYQ==',key_name='tempest-TestVolumeBootPattern-2025920441',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:45:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81bbdc35dddf43868e00e37786d69e6c',ramdisk_id='',reservation_id='r-x1ssug9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2009063389',owner_user_name='tempest-TestVolumeBootPattern-2009063389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:45:21Z,user_data=None,user_id='d99af4b031fd4f3da8957b9bd64dda26',uuid=e7a03aa8-3505-4d30-9929-abe6e0363e94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converting VIF {"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_vif [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef3bfa3-af, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43899652-3c2b-451b-a33e-a1a9a3241c73) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:49:57 user nova-compute[75409]: INFO os_vif [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:69,bridge_name='br-int',has_traffic_filtering=True,id=0ef3bfa3-afab-4d95-8771-c43422f2ee82,network=Network(1dda2e20-55e1-4661-95e9-1dca6cda8e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef3bfa3-af')
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOKYVCjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:49:57 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe77f1-79b8-474c-a0cc-6c909a80048d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:49:57 user nova-compute[75409]: No targets found.
Nov 15 21:49:57 user nova-compute[75409]: iSNS:
Nov 15 21:49:57 user nova-compute[75409]: No targets found.
Nov 15 21:49:57 user nova-compute[75409]: STATIC:
Nov 15 21:49:57 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09
Nov 15 21:49:57 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:57 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:57 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3
Nov 15 21:49:57 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:49:57 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:49:57 user nova-compute[75409]: FIRMWARE:
Nov 15 21:49:57 user nova-compute[75409]: No targets found.
Nov 15 21:49:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:49:57 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:49:57 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updated VIF entry in instance network info cache for port 0ef3bfa3-afab-4d95-8771-c43422f2ee82. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating instance_info_cache with network_info: [{"id": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "address": "fa:16:3e:3b:15:69", "network": {"id": "1dda2e20-55e1-4661-95e9-1dca6cda8e9a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-424890457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81bbdc35dddf43868e00e37786d69e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef3bfa3-af", "ovs_interfaceid": "0ef3bfa3-afab-4d95-8771-c43422f2ee82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-bc08fe7f-58b5-458f-a5ce-4568776b9f4b tempest-ServerRescueNegativeTestJSON-1998844296 tempest-ServerRescueNegativeTestJSON-1998844296-project-member] Lock "270fd5bf-1d83-42f3-80b9-b92a5f29fcbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-33688c10-d787-4d09-b0fa-8bb62b932c54 req-98f76f49-413e-4516-9757-6082fc731723 service nova] Releasing lock "refresh_cache-e7a03aa8-3505-4d30-9929-abe6e0363e94" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acf986a-f219-41c0-9968-2ad7e06310c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance e7a03aa8-3505-4d30-9929-abe6e0363e94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance b9fbb579-5374-443f-82d7-7355c0afca1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[759900a4-5396-49a3-98da-15798bda6c3c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:57 user nova-compute[75409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:49:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 (non-flash)
Nov 15 21:49:57 user nova-compute[75409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:49:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087f0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98e9ee2-1248-4c8e-adda-41ac4a30a591]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21822cd-82d8-4ff3-83c7-74d307de9bfc]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a88ce0-95e8-42fc-a2e0-cef91d7bd21d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a53a122-c6b8-4e15-85ae-96c7f36ccaa7]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e8017-93ff-47ea-b323-68d65d11f7d3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c87b8c-8ed4-4b2b-8353-5155bf0cee8c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260]
Nov 15 21:49:57 user nova-compute[75409]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09, portal: 172.16.0.220,3260] successful.
Nov 15 21:49:57 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36bd677-ec27-46cd-8d43-88c6d3265f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b783626-bd47-4771-b22e-e1f8963aecc1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] <== disconnect_volume: return (312ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:49:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:49:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Deleting instance files /opt/stack/data/nova/instances/e7a03aa8-3505-4d30-9929-abe6e0363e94_del
Nov 15 21:49:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Deletion of /opt/stack/data/nova/instances/e7a03aa8-3505-4d30-9929-abe6e0363e94_del complete
Nov 15 21:49:58 user nova-compute[75409]: INFO nova.compute.manager [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 15 21:49:58 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:49:58 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:49:58 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:49:58 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:49:58 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Took 0.40 seconds to deallocate network for instance.
Nov 15 21:49:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:49:59 user nova-compute[75409]: INFO nova.compute.manager [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Took 0.89 seconds to detach 1 volumes for instance.
Nov 15 21:49:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:49:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:49:59 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:49:59 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:49:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:49:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-fd4f1708-755f-4ed8-8c93-2b058da65684 req-ab71892c-b7c2-4a23-aa9a-548835e4663f service nova] [instance: e7a03aa8-3505-4d30-9929-abe6e0363e94] Received event network-vif-deleted-0ef3bfa3-afab-4d95-8771-c43422f2ee82 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:49:59 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Deleted allocations for instance e7a03aa8-3505-4d30-9929-abe6e0363e94
Nov 15 21:49:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4c0abc2f-846a-49ba-95bb-95c410513379 tempest-TestVolumeBootPattern-2009063389 tempest-TestVolumeBootPattern-2009063389-project-member] Lock "e7a03aa8-3505-4d30-9929-abe6e0363e94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.210s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:50:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:50:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:50:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:50:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:50:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:50:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:53 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:50:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:50:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:50:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:50:56 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.21805191040039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:50:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance b9fbb579-5374-443f-82d7-7355c0afca1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:50:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:50:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:51:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating instance_info_cache with network_info: [{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:51:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:51:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:51:15 user nova-compute[75409]: INFO nova.compute.claims [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Claim successful on node user
Nov 15 21:51:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:51:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.policy [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd1d7d8ed3d144129cfaecea98990a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa0829e23dd4a4a96ea1c87b84b61a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:51:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Creating image(s)
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "/opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "/opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk 1073741824" returned: 0 in 0.054s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Cannot resize image /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Ensure instance console log exists: /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:16 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Successfully created port: f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Successfully updated port: f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquired lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-changed-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Refreshing instance network info cache due to event network-changed-f90012da-e302-472c-b735-23fe99eb29df. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] Acquiring lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Releasing lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Instance network_info: |[{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] Acquired lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Refreshing network info cache for port f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Start _get_guest_xml network_info=[{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:51:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:51:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:51:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1757587145',display_name='tempest-SnapshotDataIntegrityTests-server-1757587145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1757587145',id=43,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEYHUP+nctW0w2QLqz6zKRYp7yxq4CZqAXxlGJ9AezF4W6c9q2GxUHNpCmmWQNYWaXQApOJPGSYf33s5o6fKbqSmGTiQysAg7WZV7xaXIbfuiYVGTLk0x352iBX8VaUJQ==',key_name='tempest-keypair-922208365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa0829e23dd4a4a96ea1c87b84b61a1',ramdisk_id='',reservation_id='r-44g7eca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1510890943',owner_user_name='tempest-SnapshotDataIntegrityTests-1510890943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1d7d8ed3d144129cfaecea98990a2e',uuid=9c165b07-4e52-4940-bafc-63cad66cff4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converting VIF {"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.objects.instance [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:51:17 user nova-compute[75409]:   <uuid>9c165b07-4e52-4940-bafc-63cad66cff4b</uuid>
Nov 15 21:51:17 user nova-compute[75409]:   <name>instance-0000002b</name>
Nov 15 21:51:17 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:51:17 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:51:17 user nova-compute[75409]:   <metadata>
Nov 15 21:51:17 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:51:17 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1757587145</nova:name>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:51:17</nova:creationTime>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:51:17 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:51:17 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:owner>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:user uuid="dd1d7d8ed3d144129cfaecea98990a2e">tempest-SnapshotDataIntegrityTests-1510890943-project-member</nova:user>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:project uuid="1fa0829e23dd4a4a96ea1c87b84b61a1">tempest-SnapshotDataIntegrityTests-1510890943</nova:project>
Nov 15 21:51:17 user nova-compute[75409]:       </nova:owner>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:51:17 user nova-compute[75409]:       <nova:ports>
Nov 15 21:51:17 user nova-compute[75409]:         <nova:port uuid="f90012da-e302-472c-b735-23fe99eb29df">
Nov 15 21:51:17 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:51:17 user nova-compute[75409]:         </nova:port>
Nov 15 21:51:17 user nova-compute[75409]:       </nova:ports>
Nov 15 21:51:17 user nova-compute[75409]:     </nova:instance>
Nov 15 21:51:17 user nova-compute[75409]:   </metadata>
Nov 15 21:51:17 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:51:17 user nova-compute[75409]:     <system>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="serial">9c165b07-4e52-4940-bafc-63cad66cff4b</entry>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="uuid">9c165b07-4e52-4940-bafc-63cad66cff4b</entry>
Nov 15 21:51:17 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:51:17 user nova-compute[75409]:     </system>
Nov 15 21:51:17 user nova-compute[75409]:   </sysinfo>
Nov 15 21:51:17 user nova-compute[75409]:   <os>
Nov 15 21:51:17 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:51:17 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:51:17 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:51:17 user nova-compute[75409]:   </os>
Nov 15 21:51:17 user nova-compute[75409]:   <features>
Nov 15 21:51:17 user nova-compute[75409]:     <acpi/>
Nov 15 21:51:17 user nova-compute[75409]:     <apic/>
Nov 15 21:51:17 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:51:17 user nova-compute[75409]:   </features>
Nov 15 21:51:17 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:51:17 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:51:17 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:51:17 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:51:17 user nova-compute[75409]:   </clock>
Nov 15 21:51:17 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:51:17 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:51:17 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:51:17 user nova-compute[75409]:   </cpu>
Nov 15 21:51:17 user nova-compute[75409]:   <devices>
Nov 15 21:51:17 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:51:17 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:51:17 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk"/>
Nov 15 21:51:17 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:51:17 user nova-compute[75409]:     </disk>
Nov 15 21:51:17 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:51:17 user nova-compute[75409]:       <mac address="fa:16:3e:03:79:7e"/>
Nov 15 21:51:17 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:51:17 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:51:17 user nova-compute[75409]:       <target dev="tapf90012da-e3"/>
Nov 15 21:51:17 user nova-compute[75409]:     </interface>
Nov 15 21:51:17 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:51:17 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/console.log" append="off"/>
Nov 15 21:51:17 user nova-compute[75409]:     </serial>
Nov 15 21:51:17 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:51:17 user nova-compute[75409]:     <video>
Nov 15 21:51:17 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:51:17 user nova-compute[75409]:     </video>
Nov 15 21:51:17 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:51:17 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:51:17 user nova-compute[75409]:     </rng>
Nov 15 21:51:17 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:51:17 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:51:17 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:51:17 user nova-compute[75409]:     </memballoon>
Nov 15 21:51:17 user nova-compute[75409]:   </devices>
Nov 15 21:51:17 user nova-compute[75409]: </domain>
Nov 15 21:51:17 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:51:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1757587145',display_name='tempest-SnapshotDataIntegrityTests-server-1757587145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1757587145',id=43,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEYHUP+nctW0w2QLqz6zKRYp7yxq4CZqAXxlGJ9AezF4W6c9q2GxUHNpCmmWQNYWaXQApOJPGSYf33s5o6fKbqSmGTiQysAg7WZV7xaXIbfuiYVGTLk0x352iBX8VaUJQ==',key_name='tempest-keypair-922208365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa0829e23dd4a4a96ea1c87b84b61a1',ramdisk_id='',reservation_id='r-44g7eca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1510890943',owner_user_name='tempest-SnapshotDataIntegrityTests-1510890943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1d7d8ed3d144129cfaecea98990a2e',uuid=9c165b07-4e52-4940-bafc-63cad66cff4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converting VIF {"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG os_vif [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19619065-bc82-58c3-b7bc-65a96f0a9b73', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf90012da-e3, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf90012da-e3, col_values=(('qos', UUID('55d534f3-c745-4293-a742-e3f336ce27db')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf90012da-e3, col_values=(('external_ids', {'iface-id': 'f90012da-e302-472c-b735-23fe99eb29df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:79:7e', 'vm-uuid': '9c165b07-4e52-4940-bafc-63cad66cff4b'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:17 user nova-compute[75409]: INFO os_vif [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3')
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No VIF found with MAC fa:16:3e:03:79:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updated VIF entry in instance network info cache for port f90012da-e302-472c-b735-23fe99eb29df. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:51:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0fd94e43-65da-412b-9a69-47eb159fbff1 req-fb146bbe-cd10-467d-b0a1-5d7956ab6f1a service nova] Releasing lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG nova.compute.manager [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] No waiting events found dispatching network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:19 user nova-compute[75409]: WARNING nova.compute.manager [req-858f0389-a025-4ab0-95e5-8d6f578977d2 req-49879497-07fa-4b70-9c24-0b3dd2848b24 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received unexpected event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df for instance with vm_state building and task_state spawning.
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:51:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Instance spawned successfully.
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.compute.manager [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] No waiting events found dispatching network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:21 user nova-compute[75409]: WARNING nova.compute.manager [req-c07362fd-abc5-4240-bb04-c098de8bf352 req-e9d329fd-845b-4b6d-970e-a745ed40699e service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received unexpected event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df for instance with vm_state building and task_state spawning.
Nov 15 21:51:21 user nova-compute[75409]: INFO nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 15 21:51:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:51:21 user nova-compute[75409]: INFO nova.compute.manager [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Took 6.41 seconds to build instance.
Nov 15 21:51:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-39f54816-9926-4a66-a422-726c096eaa9f tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.510s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-changed-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Refreshing instance network info cache due to event network-changed-1ebfaa8b-7541-44e0-9a40-5a55af818539. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] Acquiring lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] Acquired lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:51:27 user nova-compute[75409]: DEBUG nova.network.neutron [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Refreshing network info cache for port 1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:51:28 user nova-compute[75409]: DEBUG nova.network.neutron [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updated VIF entry in instance network info cache for port 1ebfaa8b-7541-44e0-9a40-5a55af818539. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:51:28 user nova-compute[75409]: DEBUG nova.network.neutron [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:51:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-d575f29b-c868-40f2-935b-3f7ceeb727eb req-913b30ab-3940-40bf-b49f-4d69b50ed510 service nova] Releasing lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 01f60e28-1c2b-4764-a0c4-bd6e323d652d {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG nova.objects.instance [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:30 user nova-compute[75409]: INFO nova.compute.manager [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attaching volume e0130b45-2b12-4f21-b28c-84455d5608b9 to /dev/vdb
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.utils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fca9a3-faa1-47c5-9d72-725fadf87a04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc64ffa2-d4e9-4201-8a72-d1600c0e59a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6d078-388e-460e-9cc0-5b867cda6a79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7462ad04-3563-4bb1-81b2-bc0346f983b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:31 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:51:31 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[019e8ccd-9fa3-467d-88ce-24339ae64693]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG os_brick.utils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:31 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating existing volume attachment record: 55b58c50-7081-4d88-9047-c36435476980 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:51:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-changed-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:33 user nova-compute[75409]: DEBUG nova.compute.manager [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Refreshing instance network info cache due to event network-changed-1e58467f-4bcc-4d98-8571-dab8acdadabd. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:51:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] Acquiring lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:51:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] Acquired lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:51:33 user nova-compute[75409]: DEBUG nova.network.neutron [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Refreshing network info cache for port 1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updated VIF entry in instance network info cache for port 1e58467f-4bcc-4d98-8571-dab8acdadabd. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG nova.network.neutron [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating instance_info_cache with network_info: [{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-865e40e5-1157-4202-a4d9-024ad6b4f6c6 req-467c9a9f-342e-4f36-ac11-f3f38e2f175d service nova] Releasing lock "refresh_cache-01f60e28-1c2b-4764-a0c4-bd6e323d652d" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: INFO nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Rebuilding instance
Nov 15 21:51:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:35 user nova-compute[75409]: WARNING nova.compute.manager [req-fa8bc92b-7207-453d-b2d3-e5a96347597f req-10583b6b-950c-46ea-a2f3-9924f8da74ff service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance destroyed successfully.
Nov 15 21:51:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance destroyed successfully.
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-137761951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e58467f-4b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06d9706e-e349-405e-8739-ca9639fa9597) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:51:36 user nova-compute[75409]: INFO os_vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b')
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f7b8a-c878-4ebb-80ea-3e6f076b2b4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:51:36 user nova-compute[75409]: No targets found.
Nov 15 21:51:36 user nova-compute[75409]: iSNS:
Nov 15 21:51:36 user nova-compute[75409]: No targets found.
Nov 15 21:51:36 user nova-compute[75409]: STATIC:
Nov 15 21:51:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3
Nov 15 21:51:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:51:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:51:36 user nova-compute[75409]: FIRMWARE:
Nov 15 21:51:36 user nova-compute[75409]: No targets found.
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:51:36 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:51:36 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ba83b9-9d39-4260-81c0-6411ce338585]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9194c8a6-fbde-4a37-8d23-d553abe59a3f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281ceb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c7ac7-7891-4f05-9bd7-11eb903a635f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cfcb1-d826-409b-8ed4-8e50b765f2c4]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9af3a4-a87b-4a49-8f67-45a0dd425968]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1581c615-d63c-4705-be1a-2dcf409b577d]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdc453071-7485dbc157047301', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dc453071', '/dev/disk/by-id/scsi-23734383564626331') {{(pid=86679) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f087ff6-03f7-434d-a461-5bc0179dc65f]: (4, None) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[525beb53-7d3e-484d-abb8-58f22af63f74]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e205fe1-b44c-4b09-ad78-07400a01d6b6]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]
Nov 15 21:51:36 user nova-compute[75409]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9a9f4-5214-482d-afee-672878532418]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== disconnect_volume: return (383ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:51:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deleting instance files /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d_del
Nov 15 21:51:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deletion of /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d_del complete
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KosTzIEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:36 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0beed9-ca61-4e28-a4cd-a72cd59612f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:51:36 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a629bd2-2542-43d4-8e60-4a66d2d4cdca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9] added
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd824dbf-ecdf-4000-ac01-70557849f622]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d20fc-d9e3-4ea4-b343-ab2561c5d2fe]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KosTzIEq {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KosTzIEq" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f71cb-3e3f-4483-95e6-2e09a02aeed2]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KosTzIEq'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d could not be found.
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df1bc5-9dd3-4afa-8bf0-af9f33792952]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e677df-5a4d-42e3-b10a-ba4c3abf90f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:51:36 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:51:36 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:51:36 user nova-compute[75409]: 
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[725f8c3e-346b-4de3-ab5c-31b7cc607827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260]
Nov 15 21:51:36 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260] successful.
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e989c21-a2a8-4343-8456-52accf246f00]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f035c27-b74e-4113-b963-af004a1dd535]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5308348-d7f2-43b4-9483-9d2ca704bb17]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:51:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KosTzIEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:37 user nova-compute[75409]: WARNING nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:37 user nova-compute[75409]: WARNING nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:37 user nova-compute[75409]: WARNING nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:37 user nova-compute[75409]: WARNING nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:51:37 user nova-compute[75409]: WARNING nova.compute.manager [req-47c956e5-1927-403a-b593-af3eeb9ef7a4 req-7174139f-ccb5-42ab-813b-e708bcb90e83 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuilding.
Nov 15 21:51:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23139633266346439', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139633266346439', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:51:37 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.163s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd804b3-5f25-405d-8d61-21cadf4bcc36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:51:38 user nova-compute[75409]: No targets found.
Nov 15 21:51:38 user nova-compute[75409]: iSNS:
Nov 15 21:51:38 user nova-compute[75409]: No targets found.
Nov 15 21:51:38 user nova-compute[75409]: STATIC:
Nov 15 21:51:38 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9
Nov 15 21:51:38 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:51:38 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:51:38 user nova-compute[75409]: FIRMWARE:
Nov 15 21:51:38 user nova-compute[75409]: No targets found.
Nov 15 21:51:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:51:38 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:51:38 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc067043-aee6-4bfb-941f-77237ffd6422]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9f73fd-1c09-4b1b-9271-4a2fb45ba30f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:38 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf0879ad40>, {}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Disconnecting from: [] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== disconnect_volume: return (1233ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:51:38 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:51:38 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:51:38 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:51:38 user nova-compute[75409]:   <serial>e0130b45-2b12-4f21-b28c-84455d5608b9</serial>
Nov 15 21:51:38 user nova-compute[75409]: </disk>
Nov 15 21:51:38 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No VIF found with MAC fa:16:3e:b9:07:f7, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:51:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-30b89157-433a-4952-8e80-3916552f6e67 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.831s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Preparing to wait for external event volume-reimaged-0a35bb87-928f-4086-9332-1b1b39883ce3 {{(pid=75409) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 21:51:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:42 user nova-compute[75409]: INFO nova.compute.manager [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attaching volume 0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 to /dev/vdc
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.utils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2f42a-24a1-4317-8e1e-a7ec12709200]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8153a5-3f9a-47f6-a2ba-3488ea55d912]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8a93ff-1ceb-4cb7-9000-0809a42d063c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[048601c7-cf78-4349-902a-0a92ccf0c2cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:42 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:51:42 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcadb79-6358-4565-9009-4cea4b259fe1]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG os_brick.utils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:42 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating existing volume attachment record: dab9fc4c-aa8b-4335-a418-4e5948e4e7b0 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:51:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:51:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyvepfcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:49 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:51:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:49 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:51:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:51:49 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:51:49 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc55dc50-ab88-4d93-8fae-062c6a890e94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:51:50 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba28d24-9944-4da7-a240-3289a6342de1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0] added
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073ce39-56b2-43e9-b8ec-dbc96361fc12]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e707c-24d6-488f-818e-d78eb4b6b444]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyvepfcP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyvepfcP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3562a7-a927-42dc-9910-18f8e7b363b9]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lyvepfcP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99040ff5-153b-4b27-82a6-34df9d0522d4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29342fb1-c3b7-4c2a-a34c-ef7379df1bf6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69ce03-f2cf-443e-aa02-a657b36895ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260]
Nov 15 21:51:50 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260] successful.
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b004415-2e93-4016-a322-cc7143d8b923]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd62414-9a14-4fa9-bb55-fefd07f6efa6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:51:50 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920adbc-2723-4961-9ad8-3d56ecf68c21]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:51:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyvepfcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23235613635656134', 'path': '/dev/sdd'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235613635656134', 'path': '/dev/sdd'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:51:51 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:51:51 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:51:51 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:51:51 user nova-compute[75409]:   <serial>0bc277e8-91d2-48b4-b95e-aaf4a5298bf0</serial>
Nov 15 21:51:51 user nova-compute[75409]: </disk>
Nov 15 21:51:51 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] No VIF found with MAC fa:16:3e:b9:07:f7, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:51:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ca581b9f-e315-4452-9f17-00f084be2d79 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.496s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:52 user nova-compute[75409]: INFO nova.compute.manager [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Detaching volume e0130b45-2b12-4f21-b28c-84455d5608b9
Nov 15 21:51:52 user nova-compute[75409]: INFO nova.virt.block_device [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attempting to driver detach volume e0130b45-2b12-4f21-b28c-84455d5608b9 from mountpoint /dev/vdb
Nov 15 21:51:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Attempting to detach device vdb from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:51:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:51:52 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:51:52 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:51:52 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:51:52 user nova-compute[75409]:   <serial>e0130b45-2b12-4f21-b28c-84455d5608b9</serial>
Nov 15 21:51:52 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:51:52 user nova-compute[75409]: </disk>
Nov 15 21:51:52 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:51:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdb from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the persistent domain config.
Nov 15 21:51:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:51:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:51:52 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:51:52 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:51:52 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:51:52 user nova-compute[75409]:   <serial>e0130b45-2b12-4f21-b28c-84455d5608b9</serial>
Nov 15 21:51:52 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:51:52 user nova-compute[75409]: </disk>
Nov 15 21:51:52 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:51:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:51:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:51:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-98bfce08-b700-4c80-b308-c1d3219548a7 req-8c988f03-0ef4-435d-95eb-743317560b08 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event volume-reimaged-0a35bb87-928f-4086-9332-1b1b39883ce3 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98bfce08-b700-4c80-b308-c1d3219548a7 req-8c988f03-0ef4-435d-95eb-743317560b08 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98bfce08-b700-4c80-b308-c1d3219548a7 req-8c988f03-0ef4-435d-95eb-743317560b08 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-98bfce08-b700-4c80-b308-c1d3219548a7 req-8c988f03-0ef4-435d-95eb-743317560b08 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG nova.compute.manager [req-98bfce08-b700-4c80-b308-c1d3219548a7 req-8c988f03-0ef4-435d-95eb-743317560b08 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Processing event volume-reimaged-0a35bb87-928f-4086-9332-1b1b39883ce3 {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:51:56 user nova-compute[75409]: INFO nova.virt.block_device [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Booting with volume 0a35bb87-928f-4086-9332-1b1b39883ce3 at /dev/vda
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.utils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6eb72-0d0b-4cb0-9beb-6918fd5c92b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254a94d-c402-434e-a051-940540366d19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9da8bd-bd27-45f8-959d-6b5697e06eb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e58853-761a-43f4-bbff-99d766dce906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:51:56 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:51:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62430a7d-fdbc-45af-a7a3-0d4da15f8a9f]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG os_brick.utils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:51:56 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating existing volume attachment record: 567dd18e-8c5b-40bb-9513-a53cd7ab7760 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:51:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:51:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:51:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:51:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.17377471923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance b9fbb579-5374-443f-82d7-7355c0afca1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:51:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:52:01 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Creating image(s)
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Ensure instance console log exists: /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start _get_guest_xml network_info=[{"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '01f60e28-1c2b-4764-a0c4-bd6e323d652d', 'attached_at': '', 'detached_at': '', 'volume_id': '0a35bb87-928f-4086-9332-1b1b39883ce3', 'serial': '0a35bb87-928f-4086-9332-1b1b39883ce3'}, 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '567dd18e-8c5b-40bb-9513-a53cd7ab7760', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:52:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 21:52:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.objects.instance [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01f60e28-1c2b-4764-a0c4-bd6e323d652d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:52:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:52:01 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:52:01 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8dc39-2da3-4803-a4ed-58a85a79d183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:52:01 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873920c-6fa5-4ab9-a234-4e97b6cf4846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3] added
Nov 15 21:52:01 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169dc51-573f-409e-89b5-c1732f4c132f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d61e0-b2d4-48f4-89b2-1d29578ea96b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfmNEYoX {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfmNEYoX" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfee4672-6f1a-4d62-b001-1347872ba90c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfmNEYoX'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75be535-0e8f-4a51-98bd-2862e3a39148]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[407a5f4b-5670-4493-9862-730e7c4727ff]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264882f-d24c-43c7-a3e9-bbb29b309c6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]
Nov 15 21:52:02 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.
Nov 15 21:52:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2490d-7938-4503-b25c-2ef8c311b4d8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e526b-05ca-497f-9869-aa6a585b4bf8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:02 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a77aa-02dc-4f33-85b4-ea5b9cdb7587]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:52:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23734383564626331', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383564626331', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-137761951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:52:03 user nova-compute[75409]:   <uuid>01f60e28-1c2b-4764-a0c4-bd6e323d652d</uuid>
Nov 15 21:52:03 user nova-compute[75409]:   <name>instance-0000002a</name>
Nov 15 21:52:03 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:52:03 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:52:03 user nova-compute[75409]:   <metadata>
Nov 15 21:52:03 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:52:03 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:52:03 user nova-compute[75409]:       <nova:name>tempest-ServerActionsV293TestJSON-server-137761951</nova:name>
Nov 15 21:52:03 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:52:01</nova:creationTime>
Nov 15 21:52:03 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:52:03 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:52:03 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:52:03 user nova-compute[75409]:       <nova:owner>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:user uuid="9289b2808c224505bc96a2a918273e70">tempest-ServerActionsV293TestJSON-1776681446-project-member</nova:user>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:project uuid="47b807bbf75d46739469d0e656d3333d">tempest-ServerActionsV293TestJSON-1776681446</nova:project>
Nov 15 21:52:03 user nova-compute[75409]:       </nova:owner>
Nov 15 21:52:03 user nova-compute[75409]:       <nova:ports>
Nov 15 21:52:03 user nova-compute[75409]:         <nova:port uuid="1e58467f-4bcc-4d98-8571-dab8acdadabd">
Nov 15 21:52:03 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 21:52:03 user nova-compute[75409]:         </nova:port>
Nov 15 21:52:03 user nova-compute[75409]:       </nova:ports>
Nov 15 21:52:03 user nova-compute[75409]:     </nova:instance>
Nov 15 21:52:03 user nova-compute[75409]:   </metadata>
Nov 15 21:52:03 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:52:03 user nova-compute[75409]:     <system>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="serial">01f60e28-1c2b-4764-a0c4-bd6e323d652d</entry>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="uuid">01f60e28-1c2b-4764-a0c4-bd6e323d652d</entry>
Nov 15 21:52:03 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:52:03 user nova-compute[75409]:     </system>
Nov 15 21:52:03 user nova-compute[75409]:   </sysinfo>
Nov 15 21:52:03 user nova-compute[75409]:   <os>
Nov 15 21:52:03 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:52:03 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:52:03 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:52:03 user nova-compute[75409]:   </os>
Nov 15 21:52:03 user nova-compute[75409]:   <features>
Nov 15 21:52:03 user nova-compute[75409]:     <acpi/>
Nov 15 21:52:03 user nova-compute[75409]:     <apic/>
Nov 15 21:52:03 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:52:03 user nova-compute[75409]:   </features>
Nov 15 21:52:03 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:52:03 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:52:03 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:52:03 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:52:03 user nova-compute[75409]:   </clock>
Nov 15 21:52:03 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:52:03 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:52:03 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:52:03 user nova-compute[75409]:   </cpu>
Nov 15 21:52:03 user nova-compute[75409]:   <devices>
Nov 15 21:52:03 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:52:03 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:52:03 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 21:52:03 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:52:03 user nova-compute[75409]:       <serial>0a35bb87-928f-4086-9332-1b1b39883ce3</serial>
Nov 15 21:52:03 user nova-compute[75409]:     </disk>
Nov 15 21:52:03 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:52:03 user nova-compute[75409]:       <mac address="fa:16:3e:6c:4b:54"/>
Nov 15 21:52:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:52:03 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:52:03 user nova-compute[75409]:       <target dev="tap1e58467f-4b"/>
Nov 15 21:52:03 user nova-compute[75409]:     </interface>
Nov 15 21:52:03 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:52:03 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d/console.log" append="off"/>
Nov 15 21:52:03 user nova-compute[75409]:     </serial>
Nov 15 21:52:03 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:52:03 user nova-compute[75409]:     <video>
Nov 15 21:52:03 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:52:03 user nova-compute[75409]:     </video>
Nov 15 21:52:03 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:52:03 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:52:03 user nova-compute[75409]:     </rng>
Nov 15 21:52:03 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:52:03 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:52:03 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:52:03 user nova-compute[75409]:     </memballoon>
Nov 15 21:52:03 user nova-compute[75409]:   </devices>
Nov 15 21:52:03 user nova-compute[75409]: </domain>
Nov 15 21:52:03 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-137761951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG os_vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21ed69d4-2917-550e-ba28-e9f8c4ace85a', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e58467f-4b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e58467f-4b, col_values=(('qos', UUID('f7dd63d0-3536-4f9e-9d8e-f944376f9768')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e58467f-4b, col_values=(('external_ids', {'iface-id': '1e58467f-4bcc-4d98-8571-dab8acdadabd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:4b:54', 'vm-uuid': '01f60e28-1c2b-4764-a0c4-bd6e323d652d'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:03 user nova-compute[75409]: INFO os_vif [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b')
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:52:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] No VIF found with MAC fa:16:3e:6c:4b:54, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:52:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:52:05 user nova-compute[75409]: WARNING nova.compute.manager [req-21d382d8-d338-4820-b034-0490ec365caa req-6c3514e0-abfe-4b1c-8915-810f157d01c9 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state rebuild_spawning.
Nov 15 21:52:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [{"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-b9fbb579-5374-443f-82d7-7355c0afca1b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:52:06 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance spawned successfully.
Nov 15 21:52:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-98bfce08-b700-4c80-b308-c1d3219548a7 tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:52:07 user nova-compute[75409]: WARNING nova.compute.manager [req-ee558122-5963-42ba-8337-a5a1fff704cb req-f7f8cd5a-a01c-4d06-9319-7751093e5c42 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state None.
Nov 15 21:52:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b9fbb579-5374-443f-82d7-7355c0afca1b is timed out.
Nov 15 21:52:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdb from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the live domain config.
Nov 15 21:52:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KosTzIEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:52:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73d219-de26-4889-a275-ff634f303962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:52:13 user nova-compute[75409]: No targets found.
Nov 15 21:52:13 user nova-compute[75409]: iSNS:
Nov 15 21:52:13 user nova-compute[75409]: No targets found.
Nov 15 21:52:13 user nova-compute[75409]: STATIC:
Nov 15 21:52:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9
Nov 15 21:52:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0
Nov 15 21:52:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:13 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3
Nov 15 21:52:13 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:13 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:13 user nova-compute[75409]: FIRMWARE:
Nov 15 21:52:13 user nova-compute[75409]: No targets found.
Nov 15 21:52:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:52:13 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:52:13 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0f770b-704c-4c69-9852-9a0b3f8b683b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b872e-3eed-4fa5-92c1-2aeae7008f3d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf0879b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[488354d1-1a35-4e91-8859-c6266c5c4791]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da7495-b642-42f1-a2f8-504b7dadf4ba]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e19451-edb8-4363-8968-9cbbac442c5d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[432566b9-2a6f-452f-ba6f-ba002b3a81aa]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e19802-c00b-4d61-8e28-de5db9a9100d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13604a15-b417-4444-b50b-329e34320aaa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260]
Nov 15 21:52:13 user nova-compute[75409]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9, portal: 172.16.0.220,3260] successful.
Nov 15 21:52:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0130b45-2b12-4f21-b28c-84455d5608b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c786749-544a-49eb-a66e-3219757fe666]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== disconnect_volume: return (317ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:52:14 user nova-compute[75409]: DEBUG nova.objects.instance [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:52:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-edc965f5-35b5-4501-ba10-c5d699679979 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.411s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:15 user nova-compute[75409]: INFO nova.compute.manager [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Detaching volume 0bc277e8-91d2-48b4-b95e-aaf4a5298bf0
Nov 15 21:52:15 user nova-compute[75409]: INFO nova.virt.block_device [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Attempting to driver detach volume 0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 from mountpoint /dev/vdc
Nov 15 21:52:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Attempting to detach device vdc from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:52:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:52:15 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:52:15 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:52:15 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:52:15 user nova-compute[75409]:   <serial>0bc277e8-91d2-48b4-b95e-aaf4a5298bf0</serial>
Nov 15 21:52:15 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:52:15 user nova-compute[75409]: </disk>
Nov 15 21:52:15 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:52:15 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdc from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the persistent domain config.
Nov 15 21:52:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:52:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:52:15 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:52:15 user nova-compute[75409]:   <source dev="/dev/sdd"/>
Nov 15 21:52:15 user nova-compute[75409]:   <target dev="vdc" bus="virtio"/>
Nov 15 21:52:15 user nova-compute[75409]:   <serial>0bc277e8-91d2-48b4-b95e-aaf4a5298bf0</serial>
Nov 15 21:52:15 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 21:52:15 user nova-compute[75409]: </disk>
Nov 15 21:52:15 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:52:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:52:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:52:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b9fbb579-5374-443f-82d7-7355c0afca1b is timed out.
Nov 15 21:52:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully detached device vdc from instance b9fbb579-5374-443f-82d7-7355c0afca1b from the live domain config.
Nov 15 21:52:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyvepfcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:52:36 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f783580-2a0e-4e29-9e4d-08a46e3b9888]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:52:36 user nova-compute[75409]: No targets found.
Nov 15 21:52:36 user nova-compute[75409]: iSNS:
Nov 15 21:52:36 user nova-compute[75409]: No targets found.
Nov 15 21:52:36 user nova-compute[75409]: STATIC:
Nov 15 21:52:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63
Nov 15 21:52:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0
Nov 15 21:52:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3
Nov 15 21:52:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:36 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c
Nov 15 21:52:36 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:52:36 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:52:36 user nova-compute[75409]: FIRMWARE:
Nov 15 21:52:36 user nova-compute[75409]: No targets found.
Nov 15 21:52:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:52:36 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:52:36 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f090cf6-b5b6-4dce-9a62-24e60e8819b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b63f1-348a-482c-aeb4-c0860a5dcdef]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c (non-flash)
Nov 15 21:52:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf78c22-e5eb-4a95-b9a2-2f1abb274b63 (non-flash)
Nov 15 21:52:36 user nova-compute[75409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bdacfad-0fcb-4625-b43d-1a766f1ee75c (non-flash)
Nov 15 21:52:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf08799bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0'): ({'sdd'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Removing single pathed devices sdd {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78024d35-b00e-4c6a-94b8-ef75bb083fc2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b8be34-0189-4c71-808a-8b0409bb1ed1]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Flushing IO for device /dev/sdd {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e63468-0dd8-4fc7-8f64-953a23e86478]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169d0e0-ae96-4eab-bb3e-51544ae31701]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] SCSI volumes sdd have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e5a5d-9287-47b8-8799-3b35f55f54db]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf447f69-4ce4-4b04-9c8b-d23bbfb704b1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260]
Nov 15 21:52:36 user nova-compute[75409]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0, portal: 172.16.0.220,3260] successful.
Nov 15 21:52:36 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc277e8-91d2-48b4-b95e-aaf4a5298bf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb02349-a5a5-4a1b-a095-a10647e5095c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] <== disconnect_volume: return (327ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:52:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:52:37 user nova-compute[75409]: DEBUG nova.objects.instance [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'flavor' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:52:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-21e6cab0-f23d-4a8d-b438-a2615b116230 tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:38 user nova-compute[75409]: INFO nova.compute.manager [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Terminating instance
Nov 15 21:52:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-unplugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] No waiting events found dispatching network-vif-unplugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:52:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-1b96515d-aa9f-4af6-82c0-5edc853ebbbf req-f5e2d59b-f7a6-40d3-90e5-78816d6ca517 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-unplugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Instance destroyed successfully.
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lazy-loading 'resources' on Instance uuid b9fbb579-5374-443f-82d7-7355c0afca1b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:49:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2124732781',display_name='tempest-AttachVolumeTestJSON-server-2124732781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2124732781',id=41,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq7O94KUrCYRRP84rVbsaT/vu/YKiqRjRVsNNaUBPBh89ljN7NT6dw/dvAasWXgG+osxedUDQhy6bwYhum7S1ZSEQG0msalBsxPK/ZOSMi6yBmvhxyohA8w8g2n1W1MnQ==',key_name='tempest-keypair-2129585454',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbce891b648d4fa299edae25edf1965a',ramdisk_id='',reservation_id='r-e6f3jydi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-753726309',owner_user_name='tempest-AttachVolumeTestJSON-753726309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e867fa9de5b345518d1e7bea923f8e55',uuid=b9fbb579-5374-443f-82d7-7355c0afca1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converting VIF {"id": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "address": "fa:16:3e:b9:07:f7", "network": {"id": "212b7175-7c38-4770-8663-3dc1262c8971", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-892176811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbce891b648d4fa299edae25edf1965a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebfaa8b-75", "ovs_interfaceid": "1ebfaa8b-7541-44e0-9a40-5a55af818539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG os_vif [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ebfaa8b-75, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9067f47c-2403-4204-a55d-8918a62ab625) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:39 user nova-compute[75409]: INFO os_vif [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:07:f7,bridge_name='br-int',has_traffic_filtering=True,id=1ebfaa8b-7541-44e0-9a40-5a55af818539,network=Network(212b7175-7c38-4770-8663-3dc1262c8971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebfaa8b-75')
Nov 15 21:52:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Deleting instance files /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b_del
Nov 15 21:52:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Deletion of /opt/stack/data/nova/instances/b9fbb579-5374-443f-82d7-7355c0afca1b_del complete
Nov 15 21:52:39 user nova-compute[75409]: INFO nova.compute.manager [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 21:52:39 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:52:39 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:52:40 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Took 0.81 seconds to deallocate network for instance.
Nov 15 21:52:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:52:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:40 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Deleted allocations for instance b9fbb579-5374-443f-82d7-7355c0afca1b
Nov 15 21:52:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e2331b86-eb1b-4d94-8b49-df823bb3bf2e tempest-AttachVolumeTestJSON-753726309 tempest-AttachVolumeTestJSON-753726309-project-member] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:52:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] Acquiring lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] Lock "b9fbb579-5374-443f-82d7-7355c0afca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] No waiting events found dispatching network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:52:41 user nova-compute[75409]: WARNING nova.compute.manager [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received unexpected event network-vif-plugged-1ebfaa8b-7541-44e0-9a40-5a55af818539 for instance with vm_state deleted and task_state None.
Nov 15 21:52:41 user nova-compute[75409]: DEBUG nova.compute.manager [req-9ca18b73-159d-4b61-94f4-f8e6aa69e550 req-e7a55338-00b7-43e8-aac5-9165c30b64f1 service nova] [instance: b9fbb579-5374-443f-82d7-7355c0afca1b] Received event network-vif-deleted-1ebfaa8b-7541-44e0-9a40-5a55af818539 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:52:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:52:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:52:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:52:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:58 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:52:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:52:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.181682586669922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:52:59 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:53:00 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:53:00 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:53:00 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:53:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-changed-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:53:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Refreshing instance network info cache due to event network-changed-f90012da-e302-472c-b735-23fe99eb29df. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:53:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] Acquiring lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:53:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] Acquired lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:53:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Refreshing network info cache for port f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updated VIF entry in instance network info cache for port f90012da-e302-472c-b735-23fe99eb29df. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7b20436-c4ef-4795-aa88-ff714c7d976a req-f606e108-7482-44e9-93d7-68ab4d297542 service nova] Releasing lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:53:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:08 user nova-compute[75409]: INFO nova.compute.manager [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attaching volume 90f98cff-f557-40cd-9e9c-e0fc29ea5c12 to /dev/vdb
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[324bab63-bb55-4868-a803-f1e440c4a81a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9371c-a2ae-4847-b4b5-032b633231d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b87146-d408-4739-afce-3bc368a69897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ff7c9-bbf5-434f-bd17-d36863926969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:53:08 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:53:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761364d-d55f-48ef-b15d-30842f128eeb]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:53:08 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating existing volume attachment record: 9ef2822a-e759-4c9c-adbf-9be503bce48d {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:53:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGFOXvIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:53:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:53:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:53:13 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f49d4-3570-4608-a56f-d165e005cc19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:53:13 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90266e9-4765-4bad-b737-a981bb6d6838]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12] added
Nov 15 21:53:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca09359b-73c3-44f3-9597-05ccbbbd7856]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7d532-220a-4f16-a399-d4f0b6c29d7a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGFOXvIu {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGFOXvIu" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3b2b7a-ed44-4f4b-bb4b-7834195e245a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGFOXvIu'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec89dff4-9bf4-44f1-8dfa-546ed98a419b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b653df04-9a1d-4379-8250-984c3aee34c1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:53:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[379f3370-594e-4437-ad5d-e21d2e9628fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260]
Nov 15 21:53:14 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260] successful.
Nov 15 21:53:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0da0944-5a18-49d0-8ae4-ac3c5074cd81]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a174272a-e4df-455e-baaf-a9f56d6e78b0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:14 user nova-compute[75409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:14 user nova-compute[75409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:14 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a52bd-27ab-4427-8aff-ccb4f847d2b3]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:53:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGFOXvIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23761643634323130', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761643634323130', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.objects.instance [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:53:15 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:53:15 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:53:15 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:53:15 user nova-compute[75409]:   <serial>90f98cff-f557-40cd-9e9c-e0fc29ea5c12</serial>
Nov 15 21:53:15 user nova-compute[75409]: </disk>
Nov 15 21:53:15 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No VIF found with MAC fa:16:3e:03:79:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:53:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-e347211a-3aa2-424a-973f-abff93b1fc40 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.922s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:26 user nova-compute[75409]: INFO nova.compute.manager [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Detaching volume 90f98cff-f557-40cd-9e9c-e0fc29ea5c12
Nov 15 21:53:26 user nova-compute[75409]: INFO nova.virt.block_device [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attempting to driver detach volume 90f98cff-f557-40cd-9e9c-e0fc29ea5c12 from mountpoint /dev/vdb
Nov 15 21:53:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Attempting to detach device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:53:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:53:26 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:53:26 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:53:26 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:53:26 user nova-compute[75409]:   <serial>90f98cff-f557-40cd-9e9c-e0fc29ea5c12</serial>
Nov 15 21:53:26 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:53:26 user nova-compute[75409]: </disk>
Nov 15 21:53:26 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:53:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config.
Nov 15 21:53:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:53:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:53:26 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:53:26 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:53:26 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:53:26 user nova-compute[75409]:   <serial>90f98cff-f557-40cd-9e9c-e0fc29ea5c12</serial>
Nov 15 21:53:26 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:53:26 user nova-compute[75409]: </disk>
Nov 15 21:53:26 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:27 user nova-compute[75409]: INFO nova.compute.manager [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Terminating instance
Nov 15 21:53:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:53:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-0a98c1e6-76ba-4d37-9322-1ad08c3faa22 req-e7bba4d5-098f-493c-a76a-1d5fe5ca8624 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-unplugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:53:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Instance destroyed successfully.
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.objects.instance [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lazy-loading 'resources' on Instance uuid 01f60e28-1c2b-4764-a0c4-bd6e323d652d {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T21:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-137761951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-892175260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoaX4RO3HxegG7I2HvpqiipKiots6RhdJL0Op1HMghQjLYg8aLAEI9d2vuqxgNtNbKvvsnu9C8EvJ0TNGlNFFqTLcoFRZslvleM+mzeygfbW5wv4IQNtdZMFsvcgMyIPA==',key_name='tempest-keypair-287800468',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47b807bbf75d46739469d0e656d3333d',ramdisk_id='',reservation_id='r-y8kkjvhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1776681446',owner_user_name='tempest-ServerActionsV293TestJSON-1776681446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9289b2808c224505bc96a2a918273e70',uuid=01f60e28-1c2b-4764-a0c4-bd6e323d652d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converting VIF {"id": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "address": "fa:16:3e:6c:4b:54", "network": {"id": "cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1621624842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47b807bbf75d46739469d0e656d3333d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e58467f-4b", "ovs_interfaceid": "1e58467f-4bcc-4d98-8571-dab8acdadabd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_vif [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e58467f-4b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7dd63d0-3536-4f9e-9d8e-f944376f9768) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:28 user nova-compute[75409]: INFO os_vif [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=1e58467f-4bcc-4d98-8571-dab8acdadabd,network=Network(cd96dbd1-84ec-4ea5-9c6e-cef1b57fcd4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e58467f-4b')
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfmNEYoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:53:28 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524e739-bdb2-4c93-a54f-258cf1f37cbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:53:28 user nova-compute[75409]: No targets found.
Nov 15 21:53:28 user nova-compute[75409]: iSNS:
Nov 15 21:53:28 user nova-compute[75409]: No targets found.
Nov 15 21:53:28 user nova-compute[75409]: STATIC:
Nov 15 21:53:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12
Nov 15 21:53:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:53:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:53:28 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3
Nov 15 21:53:28 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:53:28 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:53:28 user nova-compute[75409]: FIRMWARE:
Nov 15 21:53:28 user nova-compute[75409]: No targets found.
Nov 15 21:53:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:53:28 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:53:28 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca5603c-6802-420b-89a2-cfe65a6b2a85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef43b494-e060-4f8e-8d04-33ff9baad68c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:28 user nova-compute[75409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 (non-flash)
Nov 15 21:53:28 user nova-compute[75409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf28557520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213dcee-602b-4d25-aed8-c4692ce0deae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db463f-ae70-4f58-bcee-0eb2107d766b]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[98656693-b77e-4539-9ca1-c5d32a7b5580]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68eaabd-d55c-45f7-8f2f-7df6bf1640b5]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c3ae2-1417-48bc-8d9d-06bfa7130a3a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8d801-5b89-4ff8-893e-dda52aea1f26]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260]
Nov 15 21:53:28 user nova-compute[75409]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3, portal: 172.16.0.220,3260] successful.
Nov 15 21:53:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a35bb87-928f-4086-9332-1b1b39883ce3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[547003d8-8a34-43a2-b928-3d5ca6416551]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] <== disconnect_volume: return (336ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:53:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deleting instance files /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d_del
Nov 15 21:53:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deletion of /opt/stack/data/nova/instances/01f60e28-1c2b-4764-a0c4-bd6e323d652d_del complete
Nov 15 21:53:28 user nova-compute[75409]: INFO nova.compute.manager [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 21:53:28 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:53:28 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:53:29 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:53:29 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Took 0.72 seconds to deallocate network for instance.
Nov 15 21:53:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:53:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] Acquiring lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] No waiting events found dispatching network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:53:29 user nova-compute[75409]: WARNING nova.compute.manager [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received unexpected event network-vif-plugged-1e58467f-4bcc-4d98-8571-dab8acdadabd for instance with vm_state active and task_state deleting.
Nov 15 21:53:29 user nova-compute[75409]: DEBUG nova.compute.manager [req-7fab674c-7a24-4101-af2c-50da241664b7 req-43e82906-8771-4b30-a042-f0558a2a3443 service nova] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Received event network-vif-deleted-1e58467f-4bcc-4d98-8571-dab8acdadabd {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:53:30 user nova-compute[75409]: INFO nova.compute.manager [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Took 0.90 seconds to detach 1 volumes for instance.
Nov 15 21:53:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] [instance: 01f60e28-1c2b-4764-a0c4-bd6e323d652d] Deleting volume: 0a35bb87-928f-4086-9332-1b1b39883ce3 {{(pid=75409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:53:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:30 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Deleted allocations for instance 01f60e28-1c2b-4764-a0c4-bd6e323d652d
Nov 15 21:53:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-2a4dc818-776b-4bbc-b833-ab0bb4b2ea0a tempest-ServerActionsV293TestJSON-1776681446 tempest-ServerActionsV293TestJSON-1776681446-project-member] Lock "01f60e28-1c2b-4764-a0c4-bd6e323d652d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.419s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:53:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:53:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b is timed out.
Nov 15 21:53:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config.
Nov 15 21:53:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGFOXvIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:53:47 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93165f76-b6f1-44ad-bea1-446386abc0ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:53:47 user nova-compute[75409]: No targets found.
Nov 15 21:53:47 user nova-compute[75409]: iSNS:
Nov 15 21:53:47 user nova-compute[75409]: No targets found.
Nov 15 21:53:47 user nova-compute[75409]: STATIC:
Nov 15 21:53:47 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12
Nov 15 21:53:47 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:53:47 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:53:47 user nova-compute[75409]: FIRMWARE:
Nov 15 21:53:47 user nova-compute[75409]: No targets found.
Nov 15 21:53:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:53:47 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:53:47 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7336a3fb-4af5-43b5-9f23-b66c053f96c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[37443a1e-0e86-4d4d-a1ba-65a5ca835a5b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 (non-flash)
Nov 15 21:53:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa68714-728e-427c-99eb-a0b74a1b693d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea01415-c47c-4bce-b3cb-2659c4471af6]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d853e39c-1fb5-4005-9d87-c5305fc9556c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fcd07a-ccd9-4ed6-b133-9df554f19e94]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4770e7-c7fa-446d-851e-4a8f7113e4fd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd68ca-345e-4f30-8e96-ff2658919788]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260]
Nov 15 21:53:47 user nova-compute[75409]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12, portal: 172.16.0.220,3260] successful.
Nov 15 21:53:47 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f98cff-f557-40cd-9e9c-e0fc29ea5c12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c2c9f-0388-4f7b-b839-9329cf89454b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== disconnect_volume: return (301ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:53:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:53:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:48 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:53:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a5eb04a-289a-45f5-b4ba-d65096c57116 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:53:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:57 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:53:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:53:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:53:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:00 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.170368194580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:54:01 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:54:02 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:54:02 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:54:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:54:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 21:54:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:18 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:54:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:19 user nova-compute[75409]: INFO nova.compute.manager [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attaching volume e91c5922-6bb1-4259-892b-8c9c31d0405d to /dev/vdb
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.utils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0910c0-0082-4c8d-85f0-b46bc2967ee2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14e920-d88d-42a7-b064-5aae5ee3984f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1414979-8b4c-4c82-8096-b738d24f410c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b96a5-9e4c-4231-8c41-2536bc858495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:54:19 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:54:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f7b4f-3761-45f1-8a0a-4fdbc34b2475]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG os_brick.utils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:54:19 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating existing volume attachment record: 208d3dc7-7749-448f-b288-e4d8a97189d2 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:54:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdsgcJzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:54:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:54:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:54:23 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3558c97c-4d49-44c3-b9c0-1447992b3752]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:54:23 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1843e9be-a1de-4b39-9c17-87356d4b47c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d] added
Nov 15 21:54:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5895d400-bd22-4f3c-b887-8f231be98f53]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb081c6-9899-46be-80ff-70c1b4693a4f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdsgcJzE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdsgcJzE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe1bba-f8a7-48d1-ba3f-23d11b40f570]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdsgcJzE'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec41330-2e0b-42a6-8c1f-13c1d091047d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[444529e5-278a-42a5-ae26-40ee2885a8b9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:54:23 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:54:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:54:23 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:54:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:54:23 user nova-compute[75409]: 
Nov 15 21:54:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e1ce0-18ea-4004-8055-7cb4fdd4a6ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260]
Nov 15 21:54:24 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260] successful.
Nov 15 21:54:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770a4bc-95f6-4f28-8df1-e3fda77d8ce3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[011a97f5-fa77-4d35-8466-3d37e404e049]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)
Nov 15 21:54:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)
Nov 15 21:54:24 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3aa64-7c0f-40b5-bb8b-cc4666760dcd]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:54:24 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdsgcJzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23263323132653462', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263323132653462', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:54:25 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:54:25 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:54:25 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:54:25 user nova-compute[75409]:   <serial>e91c5922-6bb1-4259-892b-8c9c31d0405d</serial>
Nov 15 21:54:25 user nova-compute[75409]: </disk>
Nov 15 21:54:25 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No VIF found with MAC fa:16:3e:03:79:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:54:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8066c07c-b736-4f5d-9dbd-a80968bb310a tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.704s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:28 user nova-compute[75409]: INFO nova.compute.manager [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Detaching volume e91c5922-6bb1-4259-892b-8c9c31d0405d
Nov 15 21:54:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:28 user nova-compute[75409]: INFO nova.virt.block_device [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attempting to driver detach volume e91c5922-6bb1-4259-892b-8c9c31d0405d from mountpoint /dev/vdb
Nov 15 21:54:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Attempting to detach device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:54:28 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:54:28 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:54:28 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:54:28 user nova-compute[75409]:   <serial>e91c5922-6bb1-4259-892b-8c9c31d0405d</serial>
Nov 15 21:54:28 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:54:28 user nova-compute[75409]: </disk>
Nov 15 21:54:28 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:54:28 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config.
Nov 15 21:54:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:54:28 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:54:28 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:54:28 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:54:28 user nova-compute[75409]:   <serial>e91c5922-6bb1-4259-892b-8c9c31d0405d</serial>
Nov 15 21:54:28 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:54:28 user nova-compute[75409]: </disk>
Nov 15 21:54:28 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:54:30 user nova-compute[75409]: INFO nova.compute.claims [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Claim successful on node user
Nov 15 21:54:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:54:31 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.policy [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acbca9cebb9941eb8206ad4aca81cd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2f290e33ee4356a9b192bf4247a641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:54:31 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Creating image(s)
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "/opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.164s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk 1073741824" returned: 0 in 0.085s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Successfully created port: 7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Cannot resize image /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Ensure instance console log exists: /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Successfully updated port: 7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-changed-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.compute.manager [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Refreshing instance network info cache due to event network-changed-7e4c6951-7b4c-4324-bc70-895bf73cc2a6. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Instance network_info: |[{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Refreshing network info cache for port 7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Start _get_guest_xml network_info=[{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:54:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16262297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16262297',id=44,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-vqvzbgex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:54:31Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=f62194e4-7efa-44b1-a55a-8ac3cbd34c70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:54:32 user nova-compute[75409]:   <uuid>f62194e4-7efa-44b1-a55a-8ac3cbd34c70</uuid>
Nov 15 21:54:32 user nova-compute[75409]:   <name>instance-0000002c</name>
Nov 15 21:54:32 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:54:32 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:54:32 user nova-compute[75409]:   <metadata>
Nov 15 21:54:32 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:54:32 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-16262297</nova:name>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:54:32</nova:creationTime>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:54:32 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:54:32 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:owner>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 21:54:32 user nova-compute[75409]:       </nova:owner>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:54:32 user nova-compute[75409]:       <nova:ports>
Nov 15 21:54:32 user nova-compute[75409]:         <nova:port uuid="7e4c6951-7b4c-4324-bc70-895bf73cc2a6">
Nov 15 21:54:32 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 21:54:32 user nova-compute[75409]:         </nova:port>
Nov 15 21:54:32 user nova-compute[75409]:       </nova:ports>
Nov 15 21:54:32 user nova-compute[75409]:     </nova:instance>
Nov 15 21:54:32 user nova-compute[75409]:   </metadata>
Nov 15 21:54:32 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:54:32 user nova-compute[75409]:     <system>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="serial">f62194e4-7efa-44b1-a55a-8ac3cbd34c70</entry>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="uuid">f62194e4-7efa-44b1-a55a-8ac3cbd34c70</entry>
Nov 15 21:54:32 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:54:32 user nova-compute[75409]:     </system>
Nov 15 21:54:32 user nova-compute[75409]:   </sysinfo>
Nov 15 21:54:32 user nova-compute[75409]:   <os>
Nov 15 21:54:32 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:54:32 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:54:32 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:54:32 user nova-compute[75409]:   </os>
Nov 15 21:54:32 user nova-compute[75409]:   <features>
Nov 15 21:54:32 user nova-compute[75409]:     <acpi/>
Nov 15 21:54:32 user nova-compute[75409]:     <apic/>
Nov 15 21:54:32 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:54:32 user nova-compute[75409]:   </features>
Nov 15 21:54:32 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:54:32 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:54:32 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:54:32 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:54:32 user nova-compute[75409]:   </clock>
Nov 15 21:54:32 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:54:32 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:54:32 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:54:32 user nova-compute[75409]:   </cpu>
Nov 15 21:54:32 user nova-compute[75409]:   <devices>
Nov 15 21:54:32 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:54:32 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:54:32 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk"/>
Nov 15 21:54:32 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:54:32 user nova-compute[75409]:     </disk>
Nov 15 21:54:32 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:54:32 user nova-compute[75409]:       <mac address="fa:16:3e:08:8a:00"/>
Nov 15 21:54:32 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:54:32 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:54:32 user nova-compute[75409]:       <target dev="tap7e4c6951-7b"/>
Nov 15 21:54:32 user nova-compute[75409]:     </interface>
Nov 15 21:54:32 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:54:32 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/console.log" append="off"/>
Nov 15 21:54:32 user nova-compute[75409]:     </serial>
Nov 15 21:54:32 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:54:32 user nova-compute[75409]:     <video>
Nov 15 21:54:32 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:54:32 user nova-compute[75409]:     </video>
Nov 15 21:54:32 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:54:32 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:54:32 user nova-compute[75409]:     </rng>
Nov 15 21:54:32 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:54:32 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:54:32 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:54:32 user nova-compute[75409]:     </memballoon>
Nov 15 21:54:32 user nova-compute[75409]:   </devices>
Nov 15 21:54:32 user nova-compute[75409]: </domain>
Nov 15 21:54:32 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16262297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16262297',id=44,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-vqvzbgex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:54:31Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=f62194e4-7efa-44b1-a55a-8ac3cbd34c70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG os_vif [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29d92c4c-937e-5572-aba4-a38d9742ac49', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e4c6951-7b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e4c6951-7b, col_values=(('qos', UUID('4650157b-511c-41eb-8c58-49145a0b817b')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e4c6951-7b, col_values=(('external_ids', {'iface-id': '7e4c6951-7b4c-4324-bc70-895bf73cc2a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:8a:00', 'vm-uuid': 'f62194e4-7efa-44b1-a55a-8ac3cbd34c70'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:32 user nova-compute[75409]: INFO os_vif [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b')
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:08:8a:00, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated VIF entry in instance network info cache for port 7e4c6951-7b4c-4324-bc70-895bf73cc2a6. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:54:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1d0da735-1f49-49cd-ae94-8ecb97a8cd8d req-114ca31a-928e-40d2-8634-eba2a968b52d service nova] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG nova.compute.manager [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] No waiting events found dispatching network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:54:34 user nova-compute[75409]: WARNING nova.compute.manager [req-8b60f8e0-d5a3-4f98-86dd-d73f31fea960 req-810adb7b-e129-4318-8156-08da7d433eff service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received unexpected event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 for instance with vm_state building and task_state spawning.
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:54:36 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Instance spawned successfully.
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:54:36 user nova-compute[75409]: INFO nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:54:36 user nova-compute[75409]: INFO nova.compute.manager [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Took 5.80 seconds to build instance.
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] No waiting events found dispatching network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:54:36 user nova-compute[75409]: WARNING nova.compute.manager [req-0b6bbd9d-bffc-4cac-9dd0-9fc6a51a5f9f req-9eee9094-e20c-4c4e-8380-fb1f21cc8f08 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received unexpected event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 for instance with vm_state active and task_state None.
Nov 15 21:54:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cf11e4fc-25a8-4dae-bbfa-a75d4c0c75be tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.914s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:48 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b is timed out.
Nov 15 21:54:48 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config.
Nov 15 21:54:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdsgcJzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:54:48 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1fc049-2810-48c6-a258-d58ca44269e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:54:48 user nova-compute[75409]: No targets found.
Nov 15 21:54:48 user nova-compute[75409]: iSNS:
Nov 15 21:54:48 user nova-compute[75409]: No targets found.
Nov 15 21:54:48 user nova-compute[75409]: STATIC:
Nov 15 21:54:48 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d
Nov 15 21:54:48 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:54:48 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:54:48 user nova-compute[75409]: FIRMWARE:
Nov 15 21:54:48 user nova-compute[75409]: No targets found.
Nov 15 21:54:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:54:48 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:54:48 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[714367c1-a883-4424-8262-a70371e603ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c51922-6334-405e-9767-e5a26c7d7eb9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)
Nov 15 21:54:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d (non-flash)
Nov 15 21:54:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf0870d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03856901-d6fd-45a8-ac4d-c1d7b91b76fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4e85b-06da-4dfd-a50d-48459dc4282d]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[216547bc-8a66-4d79-a775-7297bd2da4f7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d91e3-498c-426b-b8a2-d4f6a70f3c54]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f21a5d2-d675-4da6-8b38-d59b0d0fcb4c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b0cf2a-bc80-44a7-a996-f5069b692230]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260]
Nov 15 21:54:48 user nova-compute[75409]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d, portal: 172.16.0.220,3260] successful.
Nov 15 21:54:48 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e91c5922-6bb1-4259-892b-8c9c31d0405d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f97b81-55b1-4815-b8ba-5f0b4be64720]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== disconnect_volume: return (271ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:54:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:54:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:54:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-078a227c-f9b2-435e-9806-6e75548cfc11 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:54:55 user nova-compute[75409]: INFO nova.compute.claims [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Claim successful on node user
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:54:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.policy [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13e23fd2123c4c238ec7b552a4cf4201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6659d659a82341bdb3b54cacf841ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:54:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Creating image(s)
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "/opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "/opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk 1073741824" returned: 0 in 0.047s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Successfully created port: cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Cannot resize image /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Ensure instance console log exists: /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Successfully updated port: cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:54:56 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.compute.manager [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing instance network info cache due to event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Instance network_info: |[{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Start _get_guest_xml network_info=[{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:54:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:57 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1026277307',display_name='tempest-TestStampPattern-server-1026277307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1026277307',id=45,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-6qb4x9te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:54:56Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=d7159b6e-90c8-45b1-b918-372a3d2a3965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'pci_devices' on Instance uuid d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:54:57 user nova-compute[75409]:   <uuid>d7159b6e-90c8-45b1-b918-372a3d2a3965</uuid>
Nov 15 21:54:57 user nova-compute[75409]:   <name>instance-0000002d</name>
Nov 15 21:54:57 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:54:57 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:54:57 user nova-compute[75409]:   <metadata>
Nov 15 21:54:57 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:54:57 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:name>tempest-TestStampPattern-server-1026277307</nova:name>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:54:57</nova:creationTime>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:54:57 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:54:57 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:owner>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:user uuid="13e23fd2123c4c238ec7b552a4cf4201">tempest-TestStampPattern-799579195-project-member</nova:user>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:project uuid="6659d659a82341bdb3b54cacf841ae8f">tempest-TestStampPattern-799579195</nova:project>
Nov 15 21:54:57 user nova-compute[75409]:       </nova:owner>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:54:57 user nova-compute[75409]:       <nova:ports>
Nov 15 21:54:57 user nova-compute[75409]:         <nova:port uuid="cadcfc25-5ade-4259-a3b5-335c9810b29a">
Nov 15 21:54:57 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 21:54:57 user nova-compute[75409]:         </nova:port>
Nov 15 21:54:57 user nova-compute[75409]:       </nova:ports>
Nov 15 21:54:57 user nova-compute[75409]:     </nova:instance>
Nov 15 21:54:57 user nova-compute[75409]:   </metadata>
Nov 15 21:54:57 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:54:57 user nova-compute[75409]:     <system>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="serial">d7159b6e-90c8-45b1-b918-372a3d2a3965</entry>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="uuid">d7159b6e-90c8-45b1-b918-372a3d2a3965</entry>
Nov 15 21:54:57 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:54:57 user nova-compute[75409]:     </system>
Nov 15 21:54:57 user nova-compute[75409]:   </sysinfo>
Nov 15 21:54:57 user nova-compute[75409]:   <os>
Nov 15 21:54:57 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:54:57 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:54:57 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:54:57 user nova-compute[75409]:   </os>
Nov 15 21:54:57 user nova-compute[75409]:   <features>
Nov 15 21:54:57 user nova-compute[75409]:     <acpi/>
Nov 15 21:54:57 user nova-compute[75409]:     <apic/>
Nov 15 21:54:57 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:54:57 user nova-compute[75409]:   </features>
Nov 15 21:54:57 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:54:57 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:54:57 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:54:57 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:54:57 user nova-compute[75409]:   </clock>
Nov 15 21:54:57 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:54:57 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:54:57 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:54:57 user nova-compute[75409]:   </cpu>
Nov 15 21:54:57 user nova-compute[75409]:   <devices>
Nov 15 21:54:57 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:54:57 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:54:57 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk"/>
Nov 15 21:54:57 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:54:57 user nova-compute[75409]:     </disk>
Nov 15 21:54:57 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:54:57 user nova-compute[75409]:       <mac address="fa:16:3e:7e:42:2f"/>
Nov 15 21:54:57 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:54:57 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:54:57 user nova-compute[75409]:       <target dev="tapcadcfc25-5a"/>
Nov 15 21:54:57 user nova-compute[75409]:     </interface>
Nov 15 21:54:57 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:54:57 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/console.log" append="off"/>
Nov 15 21:54:57 user nova-compute[75409]:     </serial>
Nov 15 21:54:57 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:54:57 user nova-compute[75409]:     <video>
Nov 15 21:54:57 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:54:57 user nova-compute[75409]:     </video>
Nov 15 21:54:57 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:54:57 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:54:57 user nova-compute[75409]:     </rng>
Nov 15 21:54:57 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:54:57 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:54:57 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:54:57 user nova-compute[75409]:     </memballoon>
Nov 15 21:54:57 user nova-compute[75409]:   </devices>
Nov 15 21:54:57 user nova-compute[75409]: </domain>
Nov 15 21:54:57 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1026277307',display_name='tempest-TestStampPattern-server-1026277307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1026277307',id=45,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-6qb4x9te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:54:56Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=d7159b6e-90c8-45b1-b918-372a3d2a3965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG os_vif [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '693c618c-c18a-5ee6-aa62-7294d7bbf32e', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcadcfc25-5a, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcadcfc25-5a, col_values=(('qos', UUID('ac85166a-5d80-46ff-ba82-1c39125d97c1')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcadcfc25-5a, col_values=(('external_ids', {'iface-id': 'cadcfc25-5ade-4259-a3b5-335c9810b29a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:42:2f', 'vm-uuid': 'd7159b6e-90c8-45b1-b918-372a3d2a3965'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:57 user nova-compute[75409]: INFO os_vif [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a')
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No VIF found with MAC fa:16:3e:7e:42:2f, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updated VIF entry in instance network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG nova.network.neutron [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:54:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-adc41771-c1be-4a9f-8f85-647d41867e62 req-2303fb51-de4e-4caf-961a-75e2e93155e4 service nova] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:54:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG nova.compute.manager [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] No waiting events found dispatching network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:54:59 user nova-compute[75409]: WARNING nova.compute.manager [req-fcbc132a-5c2e-40c0-9657-f4c27fb3b117 req-dce415bb-d461-48e5-bc5d-463bd6e4e6f5 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received unexpected event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a for instance with vm_state building and task_state spawning.
Nov 15 21:54:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:54:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:55:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Instance spawned successfully.
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:55:00 user nova-compute[75409]: INFO nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 15 21:55:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:01 user nova-compute[75409]: INFO nova.compute.manager [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Took 5.85 seconds to build instance.
Nov 15 21:55:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] No waiting events found dispatching network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:55:01 user nova-compute[75409]: WARNING nova.compute.manager [req-bb4c45a1-8c96-4d0e-8cc9-54b833458ded req-e88f5826-449e-400b-a15e-323b2989b77f service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received unexpected event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a for instance with vm_state active and task_state None.
Nov 15 21:55:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fee0c100-9cc7-4933-a7a8-53fd0e8c8389 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.942s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:55:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.12881851196289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:55:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [{"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-9c165b07-4e52-4940-bafc-63cad66cff4b" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:55:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:20 user nova-compute[75409]: INFO nova.compute.manager [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attaching volume 05501616-aff8-466b-9f95-ebb0484236e7 to /dev/vdb
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.utils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2dcf49-8385-4a6a-9845-d505963955ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd7829-7e44-433f-9a85-fd50dad91e3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fd2259-82d0-4633-a26d-81f62522655a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f8c3a-14a4-4480-8032-9678a9ef6ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:55:20 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:55:20 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d20dc-2857-4a52-aadb-46dd4dba098b]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG os_brick.utils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:55:20 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating existing volume attachment record: 04172fd3-32a6-4255-82ad-64b9be7ded4f {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:55:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBzlmsHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:55:26 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:55:26 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:55:26 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2dfd64-a103-4f06-80fc-55152b3979dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:55:26 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e04ae13-6430-4ba4-9777-2a408c601224]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7] added
Nov 15 21:55:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91250a32-1aeb-427c-b32c-98076c014075]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd72b12-f37b-4ef2-8f86-4c8369334cc7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBzlmsHc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBzlmsHc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d191e81-794f-43ff-b3f7-371f5a8ca7ef]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBzlmsHc'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b50163-bda0-420a-951e-73d3d03f139f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab66ec-69d5-49d0-b431-64e0b89cb97f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:55:26 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:55:26 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:55:26 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:55:26 user nova-compute[75409]: 
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c562a53-e054-4211-838e-0c2dc789a7cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260]
Nov 15 21:55:26 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260] successful.
Nov 15 21:55:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7159c02-af31-47aa-8584-8f2bf6717448]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[48133a94-86d1-48a2-acf7-70e743635c38]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)
Nov 15 21:55:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)
Nov 15 21:55:26 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef5b75-5a51-4f46-b242-527ec72eb48a]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:55:26 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBzlmsHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26237616564353931', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616564353931', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.objects.instance [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:55:27 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:55:27 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:55:27 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:55:27 user nova-compute[75409]:   <serial>05501616-aff8-466b-9f95-ebb0484236e7</serial>
Nov 15 21:55:27 user nova-compute[75409]: </disk>
Nov 15 21:55:27 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:55:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No VIF found with MAC fa:16:3e:03:79:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:55:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-f5a57e13-a4b1-4f1b-a8f9-80d361ecdddb tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.780s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:55:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:55:30 user nova-compute[75409]: INFO nova.compute.manager [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Detaching volume 05501616-aff8-466b-9f95-ebb0484236e7
Nov 15 21:55:30 user nova-compute[75409]: INFO nova.virt.block_device [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attempting to driver detach volume 05501616-aff8-466b-9f95-ebb0484236e7 from mountpoint /dev/vdb
Nov 15 21:55:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Attempting to detach device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:55:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:55:30 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:55:30 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:55:30 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:55:30 user nova-compute[75409]:   <serial>05501616-aff8-466b-9f95-ebb0484236e7</serial>
Nov 15 21:55:30 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:55:30 user nova-compute[75409]: </disk>
Nov 15 21:55:30 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:55:30 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config.
Nov 15 21:55:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:55:30 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:55:30 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:55:30 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:55:30 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:55:30 user nova-compute[75409]:   <serial>05501616-aff8-466b-9f95-ebb0484236e7</serial>
Nov 15 21:55:30 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:55:30 user nova-compute[75409]: </disk>
Nov 15 21:55:30 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:55:31 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:55:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:51 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b is timed out.
Nov 15 21:55:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config.
Nov 15 21:55:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBzlmsHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:55:51 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[453bdb2a-7e90-4c80-92c0-33a7d54750ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:55:51 user nova-compute[75409]: No targets found.
Nov 15 21:55:51 user nova-compute[75409]: iSNS:
Nov 15 21:55:51 user nova-compute[75409]: No targets found.
Nov 15 21:55:51 user nova-compute[75409]: STATIC:
Nov 15 21:55:51 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7
Nov 15 21:55:51 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:55:51 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:55:51 user nova-compute[75409]: FIRMWARE:
Nov 15 21:55:51 user nova-compute[75409]: No targets found.
Nov 15 21:55:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:55:51 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:55:51 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d6f9a-f83b-4493-9995-e8ff288aaa75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73810e52-e716-47e7-88a3-525e8debe312]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)
Nov 15 21:55:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 (non-flash)
Nov 15 21:55:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281cc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[543935e1-0502-425c-aac2-b16e37eb0f27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a62b8-f93b-4b7a-b320-070e3ec26eab]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd175c-a818-4438-90b6-5985207900f4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[117652a3-6efe-467d-9054-76e183062b88]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568d32a-eea1-4344-8647-3cf1e1d08ca5]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be449e-7497-4433-b944-0eca0cdfc2c4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260]
Nov 15 21:55:51 user nova-compute[75409]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7, portal: 172.16.0.220,3260] successful.
Nov 15 21:55:51 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05501616-aff8-466b-9f95-ebb0484236e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39357d-2190-4898-ada4-a4d7c6c03c2d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== disconnect_volume: return (361ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:55:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-3b2d6dee-8f71-48fa-9788-22a975161e77 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:55:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:55:59 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:55:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 21:55:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 21:56:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:02 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:56:03 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.09981918334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 21:56:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 21:56:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:56:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:56:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:56:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:56:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:56:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:56:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:56:21 user nova-compute[75409]: INFO nova.compute.manager [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] instance snapshotting
Nov 15 21:56:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Beginning live snapshot process
Nov 15 21:56:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json -f qcow2" returned: 0 in 0.229s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa.delta 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa.delta 1073741824" returned: 0 in 0.057s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:22 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 21:56:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG nova.objects.instance [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:22 user nova-compute[75409]: INFO nova.compute.manager [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attaching volume 7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 to /dev/vdb
Nov 15 21:56:22 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.utils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.038s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1076bc-32c6-4bc9-a86e-a53220b5a959]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[275fed11-a3d3-497a-8de7-0413ed0bccd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd442acb-855d-4fae-bfb5-ad039f4c1870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9ddad-dd89-4d85-9b7b-0b96cf6f9b81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:56:23 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcad4d9-f830-4da8-8628-379d4b943e2a]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG os_brick.utils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating existing volume attachment record: 0cc74f15-6be3-44d0-b479-a502331e9aa6 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:56:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 21:56:23 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa.delta /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa.delta /opt/stack/data/nova/instances/snapshots/tmpbm2moya4/e8d23f9e0f0e4fee9a8256b0864de6fa" returned: 0 in 0.333s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Snapshot extracted, beginning image upload
Nov 15 21:56:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Snapshot image upload complete
Nov 15 21:56:26 user nova-compute[75409]: INFO nova.compute.manager [None req-235b2bba-6241-44e7-be77-322031cb013a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Took 5.16 seconds to snapshot the instance on the hypervisor.
Nov 15 21:56:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QawsRNBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:56:27 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:56:27 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:56:27 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192b03e-aadb-41d0-bdaf-f812cabd0655]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:56:27 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c8a12-0ea3-4af6-bba0-828dc3daaf28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17] added
Nov 15 21:56:27 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7a872-4f1d-4d2e-9862-f9cf13a9c26f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbbac3c-e1b0-4aaa-9762-d9fbb9761533]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QawsRNBr {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QawsRNBr" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0733311-d7dd-4efe-aa14-eeecf1ad383e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QawsRNBr'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b2bae7-e944-4957-abc6-f8af03772204]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc7416-9356-4754-9252-38afff154ce3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:56:28 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:56:28 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:56:28 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:56:28 user nova-compute[75409]: 
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc84897e-7f81-4f58-bdaa-e7360db7a18f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260]
Nov 15 21:56:28 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260] successful.
Nov 15 21:56:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18592ea4-e13d-4479-95ee-a4d3d3f84d97]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d279091-7ff1-41bf-9e2f-cbe4c3da8789]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:28 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c1ace-0d57-4e4f-97df-dfcf45d5afcc]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:28 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QawsRNBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23730633961343530', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730633961343530', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.objects.instance [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:56:29 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:29 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:56:29 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:29 user nova-compute[75409]:   <serial>7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17</serial>
Nov 15 21:56:29 user nova-compute[75409]: </disk>
Nov 15 21:56:29 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] No VIF found with MAC fa:16:3e:03:79:7e, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:56:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-46b921ea-e6ac-4e0d-b51c-eb94f995822d tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.813s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:32 user nova-compute[75409]: INFO nova.compute.manager [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Detaching volume 7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17
Nov 15 21:56:32 user nova-compute[75409]: INFO nova.virt.block_device [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Attempting to driver detach volume 7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 from mountpoint /dev/vdb
Nov 15 21:56:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Attempting to detach device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:56:32 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:32 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:56:32 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:32 user nova-compute[75409]:   <serial>7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17</serial>
Nov 15 21:56:32 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:56:32 user nova-compute[75409]: </disk>
Nov 15 21:56:32 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:56:32 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the persistent domain config.
Nov 15 21:56:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:56:32 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:56:32 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:32 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 21:56:32 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:32 user nova-compute[75409]:   <serial>7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17</serial>
Nov 15 21:56:32 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:56:32 user nova-compute[75409]: </disk>
Nov 15 21:56:32 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:56:33 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:56:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:56:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.compute.manager [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing instance network info cache due to event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updated VIF entry in instance network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.network.neutron [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-5abbf22a-7667-41e8-9d74-dd99228882ef req-7f4c0b8e-51f0-4ba0-8334-612d0a0166b8 service nova] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:47 user nova-compute[75409]: INFO nova.compute.manager [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Attaching volume 3a618803-841d-48f5-848f-b2faa7dd6641 to /dev/vdb
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.utils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f57076-ebd1-438f-b173-4f1191be8ade]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5ee53-1d8a-424b-98f6-2751657f746c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba69d6d-9348-459c-9bec-a8b5af2eda0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed32a1-6564-4cca-8289-1c1a3ef19c1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:56:47 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:56:47 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ac14fe-b0ff-4a70-b67d-dcb3415ae428]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG os_brick.utils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:56:47 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating existing volume attachment record: 8f5db7b5-d8ec-4d95-b345-c36b9a76db8e {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:56:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbSvZsgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:56:52 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:56:52 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:56:52 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[51abf75f-4e45-45d1-bb27-4e184579b62e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:56:52 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc38242-7233-4f8e-9cba-d6d03886413d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641] added
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c484804-64a3-4483-9566-e830f5b01136]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7cc6df-62ef-435f-807b-ab8a7c59c0c8]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbSvZsgy {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbSvZsgy" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df352462-42ed-4800-ab87-47148142cebf]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JbSvZsgy'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe52dc3-54b2-4a5d-9254-725116157729]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6f057-4d69-466e-a233-8666ed8f93de]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3ad3b-a8d2-4a56-91d0-ddaabc72e942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260]
Nov 15 21:56:52 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260] successful.
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff87cfbe-55e9-44b3-a2ae-13f14315133a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41d0b7-a758-44ed-82e7-fd5dd7e62d1e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:56:52 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b6aaa-4902-4de0-a2a7-4ff611cd8b23]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:56:52 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbSvZsgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:56:53 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c165b07-4e52-4940-bafc-63cad66cff4b is timed out.
Nov 15 21:56:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully detached device vdb from instance 9c165b07-4e52-4940-bafc-63cad66cff4b from the live domain config.
Nov 15 21:56:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QawsRNBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:56:53 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23066633033363739', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066633033363739', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.682s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6531f33-dad9-4b61-8322-648aa14815ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:56:53 user nova-compute[75409]: No targets found.
Nov 15 21:56:53 user nova-compute[75409]: iSNS:
Nov 15 21:56:53 user nova-compute[75409]: No targets found.
Nov 15 21:56:53 user nova-compute[75409]: STATIC:
Nov 15 21:56:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17
Nov 15 21:56:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:56:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:56:53 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641
Nov 15 21:56:53 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:56:53 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:56:53 user nova-compute[75409]: FIRMWARE:
Nov 15 21:56:53 user nova-compute[75409]: No targets found.
Nov 15 21:56:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:56:53 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:56:53 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:56:53 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:53 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:56:53 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:53 user nova-compute[75409]:   <serial>3a618803-841d-48f5-848f-b2faa7dd6641</serial>
Nov 15 21:56:53 user nova-compute[75409]: </disk>
Nov 15 21:56:53 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[112638af-a5ae-4b71-b738-ba073b076522]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f17c9fe-2eda-4a32-a39f-cab393c68f62]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:53 user nova-compute[75409]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:56:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 (non-flash)
Nov 15 21:56:53 user nova-compute[75409]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:56:53 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf087f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc98adc-d904-4b04-abd4-2f9b69db0c81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89427108-4fc4-45fd-866e-4b19d0401bbc]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47d1e5-aafa-48c3-a837-c91ed3bab0bd]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e8d6d3-7846-4e9f-8213-ad400b1ffbd2]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f47d2c-99b0-40c8-8e4e-c7a54c72fc37]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6847a7-ab6c-4c0a-97e1-7e8061687a6f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260]
Nov 15 21:56:54 user nova-compute[75409]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17, portal: 172.16.0.220,3260] successful.
Nov 15 21:56:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b5b55b4-bcb3-4118-b3c1-cb73f1a97a17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5cfbb2-b459-45d5-a97b-04c7393f2b98]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] <== disconnect_volume: return (965ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No VIF found with MAC fa:16:3e:7e:42:2f, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8189fa04-e2ef-43b7-9495-c15f441fe910 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.620s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'flavor' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:56:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-08463827-f5b5-42fc-aad3-d80d1bc0d033 tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.249s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:56:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:56:57 user nova-compute[75409]: INFO nova.compute.manager [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Detaching volume 3a618803-841d-48f5-848f-b2faa7dd6641
Nov 15 21:56:57 user nova-compute[75409]: INFO nova.virt.block_device [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Attempting to driver detach volume 3a618803-841d-48f5-848f-b2faa7dd6641 from mountpoint /dev/vdb
Nov 15 21:56:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Attempting to detach device vdb from instance d7159b6e-90c8-45b1-b918-372a3d2a3965 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:56:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:57 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:56:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:57 user nova-compute[75409]:   <serial>3a618803-841d-48f5-848f-b2faa7dd6641</serial>
Nov 15 21:56:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:56:57 user nova-compute[75409]: </disk>
Nov 15 21:56:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:56:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully detached device vdb from instance d7159b6e-90c8-45b1-b918-372a3d2a3965 from the persistent domain config.
Nov 15 21:56:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7159b6e-90c8-45b1-b918-372a3d2a3965 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:56:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:56:57 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:56:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:56:57 user nova-compute[75409]:   <serial>3a618803-841d-48f5-848f-b2faa7dd6641</serial>
Nov 15 21:56:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:56:57 user nova-compute[75409]: </disk>
Nov 15 21:56:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:56:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:57:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:57:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:04 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.049354553222656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 9c165b07-4e52-4940-bafc-63cad66cff4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:57:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:57:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:57:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7159b6e-90c8-45b1-b918-372a3d2a3965 is timed out.
Nov 15 21:57:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully detached device vdb from instance d7159b6e-90c8-45b1-b918-372a3d2a3965 from the live domain config.
Nov 15 21:57:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbSvZsgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:57:17 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba9e3a8-cd7b-4802-bdb7-086883d34c4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 21:57:17 user nova-compute[75409]: No targets found.
Nov 15 21:57:17 user nova-compute[75409]: iSNS:
Nov 15 21:57:17 user nova-compute[75409]: No targets found.
Nov 15 21:57:17 user nova-compute[75409]: STATIC:
Nov 15 21:57:17 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641
Nov 15 21:57:17 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 21:57:17 user nova-compute[75409]:                 Iface Name: default
Nov 15 21:57:17 user nova-compute[75409]: FIRMWARE:
Nov 15 21:57:17 user nova-compute[75409]: No targets found.
Nov 15 21:57:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 21:57:17 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 21:57:17 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[972513aa-255a-43a3-8bd0-c11b29af3f15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa60c7-480a-4008-8470-f6c50508a670]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:57:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 (non-flash)
Nov 15 21:57:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281b4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7de4a-4ba3-4420-8a2b-bdc534066861]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb16b-e77d-49de-8d30-047e4e540517]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[115dcff4-1229-4b58-8841-0c35b186d40c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771bf1a-e23b-4fb0-a245-e55617ffd6db]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e50a8d-d1c3-49c8-bfa4-e99d75c74f53]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139f1d0-4a7f-473d-ab04-76760d93965d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260]
Nov 15 21:57:17 user nova-compute[75409]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641, portal: 172.16.0.220,3260] successful.
Nov 15 21:57:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a618803-841d-48f5-848f-b2faa7dd6641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[19427ebf-496c-4ca9-822f-8305d24fdbf1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== disconnect_volume: return (274ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:57:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 21:57:18 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:57:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1fbc006d-1622-4898-868d-6700881cc7d6 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.569s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:57:29 user nova-compute[75409]: INFO nova.compute.claims [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Claim successful on node user
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:57:29 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:57:29 user nova-compute[75409]: DEBUG nova.policy [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acbca9cebb9941eb8206ad4aca81cd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2f290e33ee4356a9b192bf4247a641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:57:29 user nova-compute[75409]: INFO nova.virt.block_device [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Booting with blank volume at /dev/vda
Nov 15 21:57:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Successfully created port: ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Successfully updated port: ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-changed-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.compute.manager [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Refreshing instance network info cache due to event network-changed-ec4c1738-4831-429b-aef9-db1ae28302d5. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance network_info: |[{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Refreshing network info cache for port ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:57:31 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated VIF entry in instance network info cache for port ec4c1738-4831-429b-aef9-db1ae28302d5. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:57:32 user nova-compute[75409]: DEBUG nova.network.neutron [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b7c0fe6f-d24c-482f-9370-a7da9879f64c req-a7d1bb45-4008-4e83-a4f6-d1ed65969be8 service nova] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:57:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.utils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa88b1-ddfd-4072-8f30-28a1abd65ee7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417b4d5-27b0-449a-b9be-38bc8eb4270e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4d083-58c7-4412-abd0-2d5b74cb4ff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7737d56-1533-4c57-9cbd-dfadc08b57fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:57:35 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:57:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1ce8a-5f62-4e07-b826-b7f7532e66a5]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG os_brick.utils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:57:35 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating existing volume attachment record: b2e604d4-d029-4ab6-bc60-197a7394466b {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:38 user nova-compute[75409]: INFO nova.compute.manager [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Terminating instance
Nov 15 21:57:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-unplugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] No waiting events found dispatching network-vif-unplugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:57:38 user nova-compute[75409]: DEBUG nova.compute.manager [req-0950bb95-6857-43e4-8cd6-7c67c5862b76 req-b701b78b-4a2e-44cb-8b26-c32be658bf9d service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-unplugged-f90012da-e302-472c-b735-23fe99eb29df for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Instance destroyed successfully.
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lazy-loading 'resources' on Instance uuid 9c165b07-4e52-4940-bafc-63cad66cff4b {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:51:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1757587145',display_name='tempest-SnapshotDataIntegrityTests-server-1757587145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1757587145',id=43,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEYHUP+nctW0w2QLqz6zKRYp7yxq4CZqAXxlGJ9AezF4W6c9q2GxUHNpCmmWQNYWaXQApOJPGSYf33s5o6fKbqSmGTiQysAg7WZV7xaXIbfuiYVGTLk0x352iBX8VaUJQ==',key_name='tempest-keypair-922208365',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa0829e23dd4a4a96ea1c87b84b61a1',ramdisk_id='',reservation_id='r-44g7eca5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1510890943',owner_user_name='tempest-SnapshotDataIntegrityTests-1510890943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd1d7d8ed3d144129cfaecea98990a2e',uuid=9c165b07-4e52-4940-bafc-63cad66cff4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converting VIF {"id": "f90012da-e302-472c-b735-23fe99eb29df", "address": "fa:16:3e:03:79:7e", "network": {"id": "63f0989b-131b-45c9-aea8-38f0b4422a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-87970850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa0829e23dd4a4a96ea1c87b84b61a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90012da-e3", "ovs_interfaceid": "f90012da-e302-472c-b735-23fe99eb29df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG os_vif [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf90012da-e3, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55d534f3-c745-4293-a742-e3f336ce27db) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:39 user nova-compute[75409]: INFO os_vif [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=f90012da-e302-472c-b735-23fe99eb29df,network=Network(63f0989b-131b-45c9-aea8-38f0b4422a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90012da-e3')
Nov 15 21:57:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Deleting instance files /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b_del
Nov 15 21:57:39 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Deletion of /opt/stack/data/nova/instances/9c165b07-4e52-4940-bafc-63cad66cff4b_del complete
Nov 15 21:57:39 user nova-compute[75409]: INFO nova.compute.manager [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 21:57:39 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 21:57:39 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:40 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Took 0.70 seconds to deallocate network for instance.
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-2849a7a6-b11c-4a89-a7f7-3f3f7c28878c req-f1eb91e8-032b-4b8c-b649-d0c8eb345616 service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-deleted-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:57:40 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Creating image(s)
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Ensure instance console log exists: /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start _get_guest_xml network_info=[{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd420ec12-97e3-4b89-ac7d-f29965223e73', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'serial': 'bbafea49-58d1-471d-96dc-b43d3b2d12f6'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b2e604d4-d029-4ab6-bc60-197a7394466b', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:57:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:40 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:57:40 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:57:40 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:57:40 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224e4c9-9064-47c7-aa37-bc97402824d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:57:40 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89002811-cbbd-4984-a314-9e738a6f4746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6] added
Nov 15 21:57:40 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8049641-693d-400b-8be8-8a4c94e1af1d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d28b3f-c2bd-42bb-952a-03e6877af7cb]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFWjnuTU {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFWjnuTU" returned: 0 in 0.029s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b318c81-1bb6-4da5-b351-991a1c426198]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFWjnuTU'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360855f-e6dc-4e75-9429-c46d8da79684]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[450f6aa3-3434-4072-9b5d-bfd7b75a60e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:57:40 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 21:57:40 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:57:40 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 21:57:40 user nova-compute[75409]: 
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:40 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Deleted allocations for instance 9c165b07-4e52-4940-bafc-63cad66cff4b
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79fa36a-583f-455c-aa58-4098a97989d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260]
Nov 15 21:57:40 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260] successful.
Nov 15 21:57:40 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e30cc-d4b9-4889-a420-43aa5bc87df0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45c460-483f-47da-9eb4-2c837fa61358]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:57:40 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:57:40 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8659dda-d5c9-4962-9c76-529552ad512d]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-992971f7-eb12-476d-82eb-cf3381b4bb1c tempest-SnapshotDataIntegrityTests-1510890943 tempest-SnapshotDataIntegrityTests-1510890943-project-member] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] Acquiring lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] Lock "9c165b07-4e52-4940-bafc-63cad66cff4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:40 user nova-compute[75409]: DEBUG nova.compute.manager [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] No waiting events found dispatching network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:57:40 user nova-compute[75409]: WARNING nova.compute.manager [req-9f99bebe-9a25-4acf-b0fe-b85be0d9d4b5 req-642b24d9-ee51-4157-93ea-d28eba6ac9dc service nova] [instance: 9c165b07-4e52-4940-bafc-63cad66cff4b] Received unexpected event network-vif-plugged-f90012da-e302-472c-b735-23fe99eb29df for instance with vm_state deleted and task_state None.
Nov 15 21:57:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26431306539343863', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431306539343863', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1161970609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1161970609',id=46,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-wioz7maa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:57:30Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=d420ec12-97e3-4b89-ac7d-f29965223e73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.objects.instance [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:57:41 user nova-compute[75409]:   <uuid>d420ec12-97e3-4b89-ac7d-f29965223e73</uuid>
Nov 15 21:57:41 user nova-compute[75409]:   <name>instance-0000002e</name>
Nov 15 21:57:41 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:57:41 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:57:41 user nova-compute[75409]:   <metadata>
Nov 15 21:57:41 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:57:41 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1161970609</nova:name>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:57:40</nova:creationTime>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:57:41 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:57:41 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:owner>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 21:57:41 user nova-compute[75409]:       </nova:owner>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:57:41 user nova-compute[75409]:       <nova:ports>
Nov 15 21:57:41 user nova-compute[75409]:         <nova:port uuid="ec4c1738-4831-429b-aef9-db1ae28302d5">
Nov 15 21:57:41 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:57:41 user nova-compute[75409]:         </nova:port>
Nov 15 21:57:41 user nova-compute[75409]:       </nova:ports>
Nov 15 21:57:41 user nova-compute[75409]:     </nova:instance>
Nov 15 21:57:41 user nova-compute[75409]:   </metadata>
Nov 15 21:57:41 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:57:41 user nova-compute[75409]:     <system>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="serial">d420ec12-97e3-4b89-ac7d-f29965223e73</entry>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="uuid">d420ec12-97e3-4b89-ac7d-f29965223e73</entry>
Nov 15 21:57:41 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:57:41 user nova-compute[75409]:     </system>
Nov 15 21:57:41 user nova-compute[75409]:   </sysinfo>
Nov 15 21:57:41 user nova-compute[75409]:   <os>
Nov 15 21:57:41 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:57:41 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:57:41 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:57:41 user nova-compute[75409]:   </os>
Nov 15 21:57:41 user nova-compute[75409]:   <features>
Nov 15 21:57:41 user nova-compute[75409]:     <acpi/>
Nov 15 21:57:41 user nova-compute[75409]:     <apic/>
Nov 15 21:57:41 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:57:41 user nova-compute[75409]:   </features>
Nov 15 21:57:41 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:57:41 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:57:41 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:57:41 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:57:41 user nova-compute[75409]:   </clock>
Nov 15 21:57:41 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:57:41 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:57:41 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:57:41 user nova-compute[75409]:   </cpu>
Nov 15 21:57:41 user nova-compute[75409]:   <devices>
Nov 15 21:57:41 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:57:41 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:57:41 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:57:41 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:57:41 user nova-compute[75409]:       <serial>bbafea49-58d1-471d-96dc-b43d3b2d12f6</serial>
Nov 15 21:57:41 user nova-compute[75409]:     </disk>
Nov 15 21:57:41 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:57:41 user nova-compute[75409]:       <mac address="fa:16:3e:0a:87:0c"/>
Nov 15 21:57:41 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:57:41 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:57:41 user nova-compute[75409]:       <target dev="tapec4c1738-48"/>
Nov 15 21:57:41 user nova-compute[75409]:     </interface>
Nov 15 21:57:41 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:57:41 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/console.log" append="off"/>
Nov 15 21:57:41 user nova-compute[75409]:     </serial>
Nov 15 21:57:41 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:57:41 user nova-compute[75409]:     <video>
Nov 15 21:57:41 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:57:41 user nova-compute[75409]:     </video>
Nov 15 21:57:41 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:57:41 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:57:41 user nova-compute[75409]:     </rng>
Nov 15 21:57:41 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:57:41 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:57:41 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:57:41 user nova-compute[75409]:     </memballoon>
Nov 15 21:57:41 user nova-compute[75409]:   </devices>
Nov 15 21:57:41 user nova-compute[75409]: </domain>
Nov 15 21:57:41 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1161970609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1161970609',id=46,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-wioz7maa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:57:30Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=d420ec12-97e3-4b89-ac7d-f29965223e73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG os_vif [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2520d847-439a-5366-99cd-828ffa42d26b', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec4c1738-48, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec4c1738-48, col_values=(('qos', UUID('8ba86832-7699-4a3b-baef-1e95d7634f2f')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec4c1738-48, col_values=(('external_ids', {'iface-id': 'ec4c1738-4831-429b-aef9-db1ae28302d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:87:0c', 'vm-uuid': 'd420ec12-97e3-4b89-ac7d-f29965223e73'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:41 user nova-compute[75409]: INFO os_vif [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48')
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:57:41 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:0a:87:0c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:57:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:43 user nova-compute[75409]: DEBUG nova.compute.manager [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:57:43 user nova-compute[75409]: WARNING nova.compute.manager [req-581b201d-9d54-4547-b61e-897a40947b69 req-c3efd979-efa6-4829-9fd8-e43726d53321 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state building and task_state spawning.
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:57:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance spawned successfully.
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:57:45 user nova-compute[75409]: INFO nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:57:45 user nova-compute[75409]: INFO nova.compute.manager [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Took 16.08 seconds to build instance.
Nov 15 21:57:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-23f85e9b-f87b-4e01-8230-f38a5378bfe4 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.184s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:57:45 user nova-compute[75409]: WARNING nova.compute.manager [req-100382ae-bd14-4ee4-b9d6-24768c79abe8 req-135b8b46-994c-4f70-a563-4104b3bf98c8 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state None.
Nov 15 21:57:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:57:50 user nova-compute[75409]: INFO nova.compute.manager [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] instance snapshotting
Nov 15 21:57:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Beginning live snapshot process
Nov 15 21:57:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4.delta 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4.delta 1073741824" returned: 0 in 0.047s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:51 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 21:57:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:51 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:57:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 21:57:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 21:57:52 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:57:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4.delta /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4.delta /opt/stack/data/nova/instances/snapshots/tmpj7_qrfqu/a891d37479d24295817b84b70f7f66b4" returned: 0 in 0.471s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Snapshot extracted, beginning image upload
Nov 15 21:57:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Snapshot image upload complete
Nov 15 21:57:55 user nova-compute[75409]: INFO nova.compute.manager [None req-8e99243f-b15a-4115-9946-8eccb131f6d8 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Took 4.96 seconds to snapshot the instance on the hypervisor.
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 21:57:56 user nova-compute[75409]: INFO nova.compute.claims [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Claim successful on node user
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 21:57:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.policy [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13e23fd2123c4c238ec7b552a4cf4201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6659d659a82341bdb3b54cacf841ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 21:57:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Creating image(s)
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "/opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "/opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "8cc881a4483407056f6097a5edbf0df915ef9879" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "8cc881a4483407056f6097a5edbf0df915ef9879" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Successfully created port: 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.virt.images [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] deb4612e-7b56-4ea1-b42c-6f4044137da7 was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.part /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.part /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.converted" returned: 0 in 0.251s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "8cc881a4483407056f6097a5edbf0df915ef9879" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Successfully updated port: 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing instance network info cache due to event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] Acquiring lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] Acquired lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing network info cache for port 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG nova.network.neutron [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "8cc881a4483407056f6097a5edbf0df915ef9879" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "8cc881a4483407056f6097a5edbf0df915ef9879" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.neutron [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c45ce478-330b-4753-b5b7-5b3e672e4e3a req-27187f0d-faaf-4b5a-aede-0f0b41165a49 service nova] Releasing lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquired lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879,backing_fmt=raw /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879,backing_fmt=raw /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk 1073741824" returned: 0 in 0.048s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "8cc881a4483407056f6097a5edbf0df915ef9879" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Ensure instance console log exists: /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating instance_info_cache with network_info: [{"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Releasing lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance network_info: |[{"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Start _get_guest_xml network_info=[{"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4ef9c2a75abdf70af3a903536386f028',container_format='bare',created_at=2023-11-15T21:57:50Z,direct_url=<?>,disk_format='qcow2',id=deb4612e-7b56-4ea1-b42c-6f4044137da7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1681779315',owner='6659d659a82341bdb3b54cacf841ae8f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T21:57:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'deb4612e-7b56-4ea1-b42c-6f4044137da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:57:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:59 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4ef9c2a75abdf70af3a903536386f028',container_format='bare',created_at=2023-11-15T21:57:50Z,direct_url=<?>,disk_format='qcow2',id=deb4612e-7b56-4ea1-b42c-6f4044137da7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1681779315',owner='6659d659a82341bdb3b54cacf841ae8f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T21:57:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1926190137',display_name='tempest-TestStampPattern-server-1926190137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1926190137',id=47,image_ref='deb4612e-7b56-4ea1-b42c-6f4044137da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-uvaspq46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d7159b6e-90c8-45b1-b918-372a3d2a3965',image_min_disk='1',image_min_ram='0',image_owner_id='6659d659a82341bdb3b54cacf841ae8f',image_owner_project_name='tempest-TestStampPattern-799579195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-799579195-project-member',image_user_id='13e23fd2123c4c238ec7b552a4cf4201',network_allocated='True',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:57:57Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=f1da7f22-6658-49a8-b229-493282c1bb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'pci_devices' on Instance uuid f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:57:59 user nova-compute[75409]:   <uuid>f1da7f22-6658-49a8-b229-493282c1bb14</uuid>
Nov 15 21:57:59 user nova-compute[75409]:   <name>instance-0000002f</name>
Nov 15 21:57:59 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:57:59 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:57:59 user nova-compute[75409]:   <metadata>
Nov 15 21:57:59 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:57:59 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:name>tempest-TestStampPattern-server-1926190137</nova:name>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:57:59</nova:creationTime>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:57:59 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:57:59 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:owner>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:user uuid="13e23fd2123c4c238ec7b552a4cf4201">tempest-TestStampPattern-799579195-project-member</nova:user>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:project uuid="6659d659a82341bdb3b54cacf841ae8f">tempest-TestStampPattern-799579195</nova:project>
Nov 15 21:57:59 user nova-compute[75409]:       </nova:owner>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:root type="image" uuid="deb4612e-7b56-4ea1-b42c-6f4044137da7"/>
Nov 15 21:57:59 user nova-compute[75409]:       <nova:ports>
Nov 15 21:57:59 user nova-compute[75409]:         <nova:port uuid="2adc03d0-d10d-4b79-ba1e-a28e835cfd3e">
Nov 15 21:57:59 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 21:57:59 user nova-compute[75409]:         </nova:port>
Nov 15 21:57:59 user nova-compute[75409]:       </nova:ports>
Nov 15 21:57:59 user nova-compute[75409]:     </nova:instance>
Nov 15 21:57:59 user nova-compute[75409]:   </metadata>
Nov 15 21:57:59 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:57:59 user nova-compute[75409]:     <system>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="serial">f1da7f22-6658-49a8-b229-493282c1bb14</entry>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="uuid">f1da7f22-6658-49a8-b229-493282c1bb14</entry>
Nov 15 21:57:59 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:57:59 user nova-compute[75409]:     </system>
Nov 15 21:57:59 user nova-compute[75409]:   </sysinfo>
Nov 15 21:57:59 user nova-compute[75409]:   <os>
Nov 15 21:57:59 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:57:59 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 21:57:59 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:57:59 user nova-compute[75409]:   </os>
Nov 15 21:57:59 user nova-compute[75409]:   <features>
Nov 15 21:57:59 user nova-compute[75409]:     <acpi/>
Nov 15 21:57:59 user nova-compute[75409]:     <apic/>
Nov 15 21:57:59 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:57:59 user nova-compute[75409]:   </features>
Nov 15 21:57:59 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:57:59 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:57:59 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:57:59 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:57:59 user nova-compute[75409]:   </clock>
Nov 15 21:57:59 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:57:59 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:57:59 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:57:59 user nova-compute[75409]:   </cpu>
Nov 15 21:57:59 user nova-compute[75409]:   <devices>
Nov 15 21:57:59 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:57:59 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:57:59 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk"/>
Nov 15 21:57:59 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:57:59 user nova-compute[75409]:     </disk>
Nov 15 21:57:59 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:57:59 user nova-compute[75409]:       <mac address="fa:16:3e:72:99:85"/>
Nov 15 21:57:59 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:57:59 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:57:59 user nova-compute[75409]:       <target dev="tap2adc03d0-d1"/>
Nov 15 21:57:59 user nova-compute[75409]:     </interface>
Nov 15 21:57:59 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:57:59 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/console.log" append="off"/>
Nov 15 21:57:59 user nova-compute[75409]:     </serial>
Nov 15 21:57:59 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:57:59 user nova-compute[75409]:     <video>
Nov 15 21:57:59 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:57:59 user nova-compute[75409]:     </video>
Nov 15 21:57:59 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:57:59 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:57:59 user nova-compute[75409]:     </rng>
Nov 15 21:57:59 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:57:59 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:57:59 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:57:59 user nova-compute[75409]:     </memballoon>
Nov 15 21:57:59 user nova-compute[75409]:   </devices>
Nov 15 21:57:59 user nova-compute[75409]: </domain>
Nov 15 21:57:59 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1926190137',display_name='tempest-TestStampPattern-server-1926190137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1926190137',id=47,image_ref='deb4612e-7b56-4ea1-b42c-6f4044137da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-uvaspq46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d7159b6e-90c8-45b1-b918-372a3d2a3965',image_min_disk='1',image_min_ram='0',image_owner_id='6659d659a82341bdb3b54cacf841ae8f',image_owner_project_name='tempest-TestStampPattern-799579195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-799579195-project-member',image_user_id='13e23fd2123c4c238ec7b552a4cf4201',network_allocated='True',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:57:57Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=f1da7f22-6658-49a8-b229-493282c1bb14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG os_vif [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'def0227e-47c5-5e57-87eb-73e1fb6d3d30', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2adc03d0-d1, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2adc03d0-d1, col_values=(('qos', UUID('b011ab82-0ecc-43cd-a22b-2ff394ff55a7')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2adc03d0-d1, col_values=(('external_ids', {'iface-id': '2adc03d0-d10d-4b79-ba1e-a28e835cfd3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:99:85', 'vm-uuid': 'f1da7f22-6658-49a8-b229-493282c1bb14'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:57:59 user nova-compute[75409]: INFO os_vif [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1')
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:57:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No VIF found with MAC fa:16:3e:72:99:85, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:58:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:58:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] No waiting events found dispatching network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:58:01 user nova-compute[75409]: WARNING nova.compute.manager [req-906957fe-434d-42f3-bdf7-96980b504837 req-78ed4827-4161-435e-9221-50d9d4b6c139 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received unexpected event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e for instance with vm_state building and task_state spawning.
Nov 15 21:58:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 21:58:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance spawned successfully.
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 21:58:03 user nova-compute[75409]: INFO nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:58:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] No waiting events found dispatching network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:58:03 user nova-compute[75409]: WARNING nova.compute.manager [req-9d3c269a-6cdf-4681-9fcc-5027899f9e86 req-178ac6a4-cffd-4ca4-aba1-40a2715a7d30 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received unexpected event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e for instance with vm_state building and task_state spawning.
Nov 15 21:58:03 user nova-compute[75409]: INFO nova.compute.manager [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Took 6.35 seconds to build instance.
Nov 15 21:58:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-1e10a818-776c-412a-b591-5250e8c27ac3 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.446s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:58:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:58:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=24.930919647216797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f1da7f22-6658-49a8-b229-493282c1bb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:58:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:58:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:58:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:58:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:58:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:58:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 21:59:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:59:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.928482055664062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f1da7f22-6658-49a8-b229-493282c1bb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 21:59:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 21:59:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 21:59:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:20 user nova-compute[75409]: INFO nova.compute.manager [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Rescuing
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG nova.network.neutron [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG nova.network.neutron [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG nova.compute.manager [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:20 user nova-compute[75409]: WARNING nova.compute.manager [req-afe6272c-31c5-4886-a808-6ab931e3f34a req-607529e9-22cb-4b00-98d2-54ea6d0a1307 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance destroyed successfully.
Nov 15 21:59:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Attempting a stable device rescue
Nov 15 21:59:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 21:59:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Creating image(s)
Nov 15 21:59:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'trusted_certs' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.part --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.virt.images [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] 10f66d41-0d9d-4ff4-bad8-b811fc212dae was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.part /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:22 user nova-compute[75409]: WARNING nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:22 user nova-compute[75409]: WARNING nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:22 user nova-compute[75409]: WARNING nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:22 user nova-compute[75409]: WARNING nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:22 user nova-compute[75409]: DEBUG nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:22 user nova-compute[75409]: WARNING nova.compute.manager [req-3a6c1e17-3872-41a4-a181-3bef5b30c016 req-944bb562-2df3-4123-bfa3-1eecffbedb4a service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.part /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.converted" returned: 0 in 0.496s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.957s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7 --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7,backing_fmt=raw /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7,backing_fmt=raw /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue" returned: 0 in 0.046s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'migration_context' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<d420ec12-97e3-4b89-ac7d-f29965223e73> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start _get_guest_xml network_info=[{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:0a:87:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10f66d41-0d9d-4ff4-bad8-b811fc212dae', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd420ec12-97e3-4b89-ac7d-f29965223e73', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'serial': 'bbafea49-58d1-471d-96dc-b43d3b2d12f6'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b2e604d4-d029-4ab6-bc60-197a7394466b', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<d420ec12-97e3-4b89-ac7d-f29965223e73> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'numa_topology' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<d420ec12-97e3-4b89-ac7d-f29965223e73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:59:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:59:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'vcpu_model' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<d420ec12-97e3-4b89-ac7d-f29965223e73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:59:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:59:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:59:23 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb88f2-436a-4653-a43c-7283566dd803]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KFWjnuTU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 21:59:23 user nova-compute[75409]: node.name = iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6
Nov 15 21:59:23 user nova-compute[75409]: node.tpgt = -1
Nov 15 21:59:23 user nova-compute[75409]: node.startup = automatic
Nov 15 21:59:23 user nova-compute[75409]: node.leading_login = No
Nov 15 21:59:23 user nova-compute[75409]: iface.iscsi_ifacename = default
Nov 15 21:59:23 user nova-compute[75409]: iface.net_ifacename = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.ipaddress = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.prefix_len = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.hwaddress = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.transport_name = tcp
Nov 15 21:59:23 user nova-compute[75409]: iface.initiatorname = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.vlan_id = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.vlan_priority = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.vlan_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.iface_num = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.mtu = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.port = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.bootproto = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.subnet_mask = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.gateway = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_alt_client_id = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_dns = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_learn_iqn = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_vendor_id_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_vendor_id = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.dhcp_slp_da = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.fragmentation = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.gratuitous_arp = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.incoming_forwarding = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.tos_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.tos = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.ttl = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.delayed_ack = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.tcp_nagle = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.tcp_wsf_state = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.tcp_wsf = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.tcp_timer_scale = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.tcp_timestamp = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.redirect = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.def_task_mgmt_timeout = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.header_digest = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.data_digest = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.immediate_data = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.initial_r2t = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.data_seq_inorder = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.data_pdu_inorder = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.erl = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.max_receive_data_len = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.first_burst_len = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.max_outstanding_r2t = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.max_burst_len = 0
Nov 15 21:59:23 user nova-compute[75409]: iface.chap_auth = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.bidi_chap = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.strict_login_compliance = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.discovery_auth = <empty>
Nov 15 21:59:23 user nova-compute[75409]: iface.discovery_logout = <empty>
Nov 15 21:59:23 user nova-compute[75409]: node.discovery_address = <empty>
Nov 15 21:59:23 user nova-compute[75409]: node.discovery_port = 0
Nov 15 21:59:23 user nova-compute[75409]: node.discovery_type = static
Nov 15 21:59:23 user nova-compute[75409]: node.session.initial_cmdsn = 0
Nov 15 21:59:23 user nova-compute[75409]: node.session.initial_login_retry_max = 8
Nov 15 21:59:23 user nova-compute[75409]: node.session.xmit_thread_priority = -20
Nov 15 21:59:23 user nova-compute[75409]: node.session.cmds_max = 128
Nov 15 21:59:23 user nova-compute[75409]: node.session.queue_depth = 32
Nov 15 21:59:23 user nova-compute[75409]: node.session.nr_sessions = 1
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.authmethod = CHAP
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.username = KFWjnuTU
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.password = ***
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.username_in = <empty>
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.password_in = <empty>
Nov 15 21:59:23 user nova-compute[75409]: node.session.auth.chap_algs = MD5
Nov 15 21:59:23 user nova-compute[75409]: node.session.timeo.replacement_timeout = 120
Nov 15 21:59:23 user nova-compute[75409]: node.session.err_timeo.abort_timeout = 15
Nov 15 21:59:23 user nova-compute[75409]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 21:59:23 user nova-compute[75409]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 21:59:23 user nova-compute[75409]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.FastAbort = Yes
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.InitialR2T = No
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.ImmediateData = Yes
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.MaxConnections = 1
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 21:59:23 user nova-compute[75409]: node.session.iscsi.ERL = 0
Nov 15 21:59:23 user nova-compute[75409]: node.session.scan = manual
Nov 15 21:59:23 user nova-compute[75409]: node.session.reopen_max = 0
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].address = 172.16.0.220
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].port = 3260
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].startup = manual
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].tcp.window_size = 524288
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].tcp.type_of_service = 0
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].timeo.logout_timeout = 15
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].timeo.login_timeout = 15
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].timeo.auth_timeout = 45
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.DataDigest = None
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.IFMarker = No
Nov 15 21:59:23 user nova-compute[75409]: node.conn[0].iscsi.OFMarker = No
Nov 15 21:59:23 user nova-compute[75409]: # END RECORD
Nov 15 21:59:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b6aca-a73b-4b2b-9119-df2c3148971b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d560b04-e225-4b8f-a088-8f37fa1dd9e7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFWjnuTU {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFWjnuTU" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a0fea-cd88-4961-9d87-efe9a1456cf1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFWjnuTU'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c22679-74b1-4b0b-893b-2542153a54f4]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7953f54-e414-499d-88f1-75fe06081ba1]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] HCTL ('33', '0', '0', 0) found on session 61 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bfbbb-66e7-4309-bd2d-f7668e440b22]: (4, ('0 0 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching for a device in session 61 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== connect_volume: return (158ms) {'type': 'block', 'scsi_wwn': '26431306539343863', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431306539343863', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1161970609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1161970609',id=46,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-wioz7maa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T21:57:45Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=d420ec12-97e3-4b89-ac7d-f29965223e73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:0a:87:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:0a:87:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.instance [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.objects.base [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<d420ec12-97e3-4b89-ac7d-f29965223e73> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] End _get_guest_xml xml=<domain type="kvm">
Nov 15 21:59:23 user nova-compute[75409]:   <uuid>d420ec12-97e3-4b89-ac7d-f29965223e73</uuid>
Nov 15 21:59:23 user nova-compute[75409]:   <name>instance-0000002e</name>
Nov 15 21:59:23 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 21:59:23 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 21:59:23 user nova-compute[75409]:   <metadata>
Nov 15 21:59:23 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 21:59:23 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1161970609</nova:name>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:creationTime>2023-11-15 21:59:23</nova:creationTime>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 21:59:23 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 21:59:23 user nova-compute[75409]:       </nova:flavor>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:owner>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 21:59:23 user nova-compute[75409]:       </nova:owner>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 21:59:23 user nova-compute[75409]:       <nova:ports>
Nov 15 21:59:23 user nova-compute[75409]:         <nova:port uuid="ec4c1738-4831-429b-aef9-db1ae28302d5">
Nov 15 21:59:23 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 21:59:23 user nova-compute[75409]:         </nova:port>
Nov 15 21:59:23 user nova-compute[75409]:       </nova:ports>
Nov 15 21:59:23 user nova-compute[75409]:     </nova:instance>
Nov 15 21:59:23 user nova-compute[75409]:   </metadata>
Nov 15 21:59:23 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 21:59:23 user nova-compute[75409]:     <system>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="serial">d420ec12-97e3-4b89-ac7d-f29965223e73</entry>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="uuid">d420ec12-97e3-4b89-ac7d-f29965223e73</entry>
Nov 15 21:59:23 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 21:59:23 user nova-compute[75409]:     </system>
Nov 15 21:59:23 user nova-compute[75409]:   </sysinfo>
Nov 15 21:59:23 user nova-compute[75409]:   <os>
Nov 15 21:59:23 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 21:59:23 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 21:59:23 user nova-compute[75409]:   </os>
Nov 15 21:59:23 user nova-compute[75409]:   <features>
Nov 15 21:59:23 user nova-compute[75409]:     <acpi/>
Nov 15 21:59:23 user nova-compute[75409]:     <apic/>
Nov 15 21:59:23 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 21:59:23 user nova-compute[75409]:   </features>
Nov 15 21:59:23 user nova-compute[75409]:   <clock offset="utc">
Nov 15 21:59:23 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 21:59:23 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 21:59:23 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 21:59:23 user nova-compute[75409]:   </clock>
Nov 15 21:59:23 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 21:59:23 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 21:59:23 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 21:59:23 user nova-compute[75409]:   </cpu>
Nov 15 21:59:23 user nova-compute[75409]:   <devices>
Nov 15 21:59:23 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 21:59:23 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:59:23 user nova-compute[75409]:       <source dev="/dev/sdb"/>
Nov 15 21:59:23 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 21:59:23 user nova-compute[75409]:       <serial>bbafea49-58d1-471d-96dc-b43d3b2d12f6</serial>
Nov 15 21:59:23 user nova-compute[75409]:     </disk>
Nov 15 21:59:23 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 21:59:23 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 21:59:23 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue"/>
Nov 15 21:59:23 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 21:59:23 user nova-compute[75409]:       <boot order="1"/>
Nov 15 21:59:23 user nova-compute[75409]:     </disk>
Nov 15 21:59:23 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 21:59:23 user nova-compute[75409]:       <mac address="fa:16:3e:0a:87:0c"/>
Nov 15 21:59:23 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:59:23 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 21:59:23 user nova-compute[75409]:       <target dev="tapec4c1738-48"/>
Nov 15 21:59:23 user nova-compute[75409]:     </interface>
Nov 15 21:59:23 user nova-compute[75409]:     <serial type="pty">
Nov 15 21:59:23 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/console.log" append="off"/>
Nov 15 21:59:23 user nova-compute[75409]:     </serial>
Nov 15 21:59:23 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 21:59:23 user nova-compute[75409]:     <video>
Nov 15 21:59:23 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 21:59:23 user nova-compute[75409]:     </video>
Nov 15 21:59:23 user nova-compute[75409]:     <rng model="virtio">
Nov 15 21:59:23 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 21:59:23 user nova-compute[75409]:     </rng>
Nov 15 21:59:23 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 21:59:23 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 21:59:23 user nova-compute[75409]:       <stats period="10"/>
Nov 15 21:59:23 user nova-compute[75409]:     </memballoon>
Nov 15 21:59:23 user nova-compute[75409]:   </devices>
Nov 15 21:59:23 user nova-compute[75409]: </domain>
Nov 15 21:59:23 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 21:59:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance destroyed successfully.
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:59:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:0a:87:0c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:59:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:25 user nova-compute[75409]: WARNING nova.compute.manager [req-8262238e-1b25-47f8-91d4-a43a1a03b74f req-ba09c03a-8eb9-481d-8d75-9fffb1abf249 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-79a3e577-48f4-416f-b5af-3f84b0312e67 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 21:59:27 user nova-compute[75409]: WARNING nova.compute.manager [req-db679830-22ba-482f-a46b-51da81efc1b5 req-9b28d45d-1bbb-491f-bcc4-637d26853602 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state rescuing.
Nov 15 21:59:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 21:59:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing instance network info cache due to event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] Acquiring lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] Acquired lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing network info cache for port 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updated VIF entry in instance network info cache for port 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG nova.network.neutron [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating instance_info_cache with network_info: [{"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 21:59:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-73d229c0-e875-4912-83e4-30ed4269dec1 req-b5c2994b-8c41-4ef6-b6ae-82b9d1958401 service nova] Releasing lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 21:59:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:50 user nova-compute[75409]: INFO nova.compute.manager [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Attaching volume 07dc5dcf-3da8-40ba-aee8-ee9f80444429 to /dev/vdb
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b0af6-6414-484c-a01e-8e7573c113be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[83314afc-212c-4159-a199-0f9892cc941b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323fd45-b10e-4380-9d66-3bace1cbfcea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[075193d7-ac10-45c0-94c3-bcfd36556cf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 21:59:50 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 21:59:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a332a8f6-abae-4723-9e76-1140a06c8b5a]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:59:50 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating existing volume attachment record: 341bcdb8-f284-49c6-8d7d-93b9bbea73b0 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcNwYosM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 21:59:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:59:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 21:59:54 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc3b4c0-9d56-41c5-8ad9-f0351e3f48bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 21:59:54 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42e06c-104d-4a27-b46a-4112a2257ca5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429] added
Nov 15 21:59:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e9e34-4e97-4e8b-9170-c3576949a466]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b506de03-fc1e-4993-ba1e-06dddd5e9546]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcNwYosM {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcNwYosM" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31002a65-b6d7-4f6b-ac37-c76957f6f8d7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HcNwYosM'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c4821-7eee-478b-9ea9-99151d027939]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040d2c8-88f7-4b05-bac0-b43f7d740fec]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6dba9-b009-4d3d-be1f-2d12de29c457]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260]
Nov 15 21:59:55 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260] successful.
Nov 15 21:59:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8105e7ab-bd9a-43ce-bed5-00859c6bf174]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2124e1-7786-4fc6-a333-b67ff5af180b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)
Nov 15 21:59:55 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268fb8d-d0e0-48fd-b743-ff81e519c4fb]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcNwYosM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 21:59:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23433633234323738', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433633234323738', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 21:59:56 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:59:56 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:59:56 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:59:56 user nova-compute[75409]:   <serial>07dc5dcf-3da8-40ba-aee8-ee9f80444429</serial>
Nov 15 21:59:56 user nova-compute[75409]: </disk>
Nov 15 21:59:56 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] No VIF found with MAC fa:16:3e:72:99:85, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 21:59:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-8cbe0e5e-e54e-4da4-818a-178182955bf0 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.515s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 21:59:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 21:59:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 21:59:57 user nova-compute[75409]: INFO nova.compute.manager [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Detaching volume 07dc5dcf-3da8-40ba-aee8-ee9f80444429
Nov 15 21:59:57 user nova-compute[75409]: INFO nova.virt.block_device [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Attempting to driver detach volume 07dc5dcf-3da8-40ba-aee8-ee9f80444429 from mountpoint /dev/vdb
Nov 15 21:59:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Attempting to detach device vdb from instance f1da7f22-6658-49a8-b229-493282c1bb14 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 21:59:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:59:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:59:57 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:59:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:59:57 user nova-compute[75409]:   <serial>07dc5dcf-3da8-40ba-aee8-ee9f80444429</serial>
Nov 15 21:59:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:59:57 user nova-compute[75409]: </disk>
Nov 15 21:59:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:59:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully detached device vdb from instance f1da7f22-6658-49a8-b229-493282c1bb14 from the persistent domain config.
Nov 15 21:59:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1da7f22-6658-49a8-b229-493282c1bb14 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 21:59:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 21:59:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 21:59:57 user nova-compute[75409]:   <source dev="/dev/sdc"/>
Nov 15 21:59:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 21:59:57 user nova-compute[75409]:   <serial>07dc5dcf-3da8-40ba-aee8-ee9f80444429</serial>
Nov 15 21:59:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 21:59:57 user nova-compute[75409]: </disk>
Nov 15 21:59:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 21:59:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 21:59:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:00:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:00:06 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:00:07 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:00:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=24.82333755493164GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f1da7f22-6658-49a8-b229-493282c1bb14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:00:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:00:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:18 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1da7f22-6658-49a8-b229-493282c1bb14 is timed out.
Nov 15 22:00:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully detached device vdb from instance f1da7f22-6658-49a8-b229-493282c1bb14 from the live domain config.
Nov 15 22:00:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcNwYosM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:00:18 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e15c7-2d44-45e1-ab85-acd8a3f6aea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:00:18 user nova-compute[75409]: No targets found.
Nov 15 22:00:18 user nova-compute[75409]: iSNS:
Nov 15 22:00:18 user nova-compute[75409]: No targets found.
Nov 15 22:00:18 user nova-compute[75409]: STATIC:
Nov 15 22:00:18 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429
Nov 15 22:00:18 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:00:18 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:00:18 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6
Nov 15 22:00:18 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:00:18 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:00:18 user nova-compute[75409]: FIRMWARE:
Nov 15 22:00:18 user nova-compute[75409]: No targets found.
Nov 15 22:00:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:00:18 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:00:18 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef656230-6021-4424-805e-25fa105c2e69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0eb17-412a-4635-9ffa-7047c4ee910e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:00:18 user nova-compute[75409]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)
Nov 15 22:00:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:00:18 user nova-compute[75409]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 (non-flash)
Nov 15 22:00:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf48100dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d5280-60bc-4e8f-ab6f-18550dd23ea0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c180a9-398a-424c-a7ec-04c73eea7279]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec7aa29-41de-4420-ade3-abb206884797]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e4831-3ded-4e6e-bcb8-a47958dd9677]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf64de9-027f-4882-b9ac-f20d791c9733]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b1c4b-a826-4491-a454-2652b56bff0e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260]
Nov 15 22:00:18 user nova-compute[75409]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429, portal: 172.16.0.220,3260] successful.
Nov 15 22:00:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07dc5dcf-3da8-40ba-aee8-ee9f80444429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21efe9b-0663-4155-9b90-bf0b438343e6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] <== disconnect_volume: return (331ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:00:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:00:19 user nova-compute[75409]: DEBUG nova.objects.instance [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'flavor' on Instance uuid f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:00:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-66b793c9-7fe0-461d-b900-5b0f6ceeb993 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.648s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Verify base images {{(pid=75409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Image id deb4612e-7b56-4ea1-b42c-6f4044137da7 yields fingerprint 8cc881a4483407056f6097a5edbf0df915ef9879 {{(pid=75409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] image deb4612e-7b56-4ea1-b42c-6f4044137da7 at (/opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879): checking
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] image deb4612e-7b56-4ea1-b42c-6f4044137da7 at (/opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879): image is in use {{(pid=75409) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Image id 76e2224a-f851-4f51-8b88-3264d76e2cea yields fingerprint 59fd04301ac14f21be580f6b784d89f0f955d573 {{(pid=75409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] image 76e2224a-f851-4f51-8b88-3264d76e2cea at (/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573): checking
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] image 76e2224a-f851-4f51-8b88-3264d76e2cea at (/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573): image is in use {{(pid=75409) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] d420ec12-97e3-4b89-ac7d-f29965223e73 is a valid instance name {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] f1da7f22-6658-49a8-b229-493282c1bb14 is a valid instance name {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] f1da7f22-6658-49a8-b229-493282c1bb14 has a disk file {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f1da7f22-6658-49a8-b229-493282c1bb14 is backed by 8cc881a4483407056f6097a5edbf0df915ef9879 {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] f62194e4-7efa-44b1-a55a-8ac3cbd34c70 is a valid instance name {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] f62194e4-7efa-44b1-a55a-8ac3cbd34c70 has a disk file {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 is backed by 59fd04301ac14f21be580f6b784d89f0f955d573 {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] d7159b6e-90c8-45b1-b918-372a3d2a3965 is a valid instance name {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] d7159b6e-90c8-45b1-b918-372a3d2a3965 has a disk file {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 is backed by 59fd04301ac14f21be580f6b784d89f0f955d573 {{(pid=75409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba
Nov 15 22:00:28 user nova-compute[75409]: WARNING nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Active base files: /opt/stack/data/nova/instances/_base/8cc881a4483407056f6097a5edbf0df915ef9879 /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Removable base files: /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696 /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3 /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7 /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93 /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07a1e41686f7363ac52c7c4f8b8fde797d319696
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5e21906bff65c9512283050331fe4196d3a789d3
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf6a48d7051f8012b02faef5ec5d2190cb11473b
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f06e5bfe4960d5ba2caf425cd86f52bb641f3d7
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c41cfba70954f510b8a9b7eb1a304b7d7cd5f93
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b36079ffa3d2575110765c7bb03e63f15f193fba
Nov 15 22:00:28 user nova-compute[75409]: INFO nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ef3e963213803d473a49c608fce2d15b6760cf5
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Verification complete {{(pid=75409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Verify swap images {{(pid=75409) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 22:00:28 user nova-compute[75409]: DEBUG nova.virt.libvirt.imagecache [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Verify ephemeral images {{(pid=75409) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 22:00:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:00:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:00:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:00:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing instance network info cache due to event network-changed-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] Acquiring lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] Acquired lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Refreshing network info cache for port 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:49 user nova-compute[75409]: INFO nova.compute.manager [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Terminating instance
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-unplugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] No waiting events found dispatching network-vif-unplugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-090301f1-9b06-4e1e-a5bd-43f1361a2728 req-4b99c304-70f6-44d8-ada4-be19b55d8dfc service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-unplugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updated VIF entry in instance network info cache for port 2adc03d0-d10d-4b79-ba1e-a28e835cfd3e. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating instance_info_cache with network_info: [{"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:00:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-46529a75-4b58-4f40-a377-5e24a736f37c req-d298e7d9-c363-486b-b6f7-10aad8e29aae service nova] Releasing lock "refresh_cache-f1da7f22-6658-49a8-b229-493282c1bb14" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Instance destroyed successfully.
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'resources' on Instance uuid f1da7f22-6658-49a8-b229-493282c1bb14 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1926190137',display_name='tempest-TestStampPattern-server-1926190137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1926190137',id=47,image_ref='deb4612e-7b56-4ea1-b42c-6f4044137da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-uvaspq46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d7159b6e-90c8-45b1-b918-372a3d2a3965',image_min_disk='1',image_min_ram='0',image_owner_id='6659d659a82341bdb3b54cacf841ae8f',image_owner_project_name='tempest-TestStampPattern-799579195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-799579195-project-member',image_user_id='13e23fd2123c4c238ec7b552a4cf4201',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:58:03Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=f1da7f22-6658-49a8-b229-493282c1bb14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "address": "fa:16:3e:72:99:85", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2adc03d0-d1", "ovs_interfaceid": "2adc03d0-d10d-4b79-ba1e-a28e835cfd3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG os_vif [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2adc03d0-d1, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b011ab82-0ecc-43cd-a22b-2ff394ff55a7) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:00:50 user nova-compute[75409]: INFO os_vif [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:99:85,bridge_name='br-int',has_traffic_filtering=True,id=2adc03d0-d10d-4b79-ba1e-a28e835cfd3e,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2adc03d0-d1')
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Deleting instance files /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14_del
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Deletion of /opt/stack/data/nova/instances/f1da7f22-6658-49a8-b229-493282c1bb14_del complete
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.compute.manager [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 22:00:50 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Took 0.39 seconds to deallocate network for instance.
Nov 15 22:00:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:00:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:50 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Deleted allocations for instance f1da7f22-6658-49a8-b229-493282c1bb14
Nov 15 22:00:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-795082db-2ded-4753-8dca-61c3a98d101a tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "f1da7f22-6658-49a8-b229-493282c1bb14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.609s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-bc3bfc91-ba0a-4d14-8127-b8b71e457444 req-c4636802-d0b8-48db-8e23-55684e5c7aae service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-deleted-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] Acquiring lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] Lock "f1da7f22-6658-49a8-b229-493282c1bb14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:00:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] No waiting events found dispatching network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:00:51 user nova-compute[75409]: WARNING nova.compute.manager [req-1632eb47-b6a3-4029-ae5d-24458f64ebed req-f0d45cf4-b83d-4ea0-b0fd-39e6761549ba service nova] [instance: f1da7f22-6658-49a8-b229-493282c1bb14] Received unexpected event network-vif-plugged-2adc03d0-d10d-4b79-ba1e-a28e835cfd3e for instance with vm_state deleted and task_state None.
Nov 15 22:00:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:04 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:01:07 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:01:08 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:01:08 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=24.82349395751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d7159b6e-90c8-45b1-b918-372a3d2a3965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:01:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:01:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:01:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:11 user nova-compute[75409]: INFO nova.compute.manager [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Unrescuing
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'flavor' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:11 user nova-compute[75409]: WARNING nova.compute.manager [req-9a5504ac-ef93-40e6-b856-4f7ed84dd014 req-15e9f4d5-cd3e-4533-9bff-17833c3994e0 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:01:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:01:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:12 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance destroyed successfully.
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:14 user nova-compute[75409]: WARNING nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:01:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:14 user nova-compute[75409]: WARNING nova.compute.manager [req-3e27495f-4a6d-43c9-815a-835c82188624 req-1eaee3d0-1c46-4e37-86df-e493bd687f1d service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4dbb3522-baca-4cb8-b7c6-df8efc81b546 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:01:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:16 user nova-compute[75409]: WARNING nova.compute.manager [req-e7c4d261-5441-47be-9858-787190e0f739 req-a6fa0234-67fe-419c-a9db-6c874f2f09fd service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state None.
Nov 15 22:01:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:01:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing instance network info cache due to event network-changed-cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] Acquiring lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] Acquired lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Refreshing network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:45 user nova-compute[75409]: INFO nova.compute.manager [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Terminating instance
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-unplugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] No waiting events found dispatching network-vif-unplugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.compute.manager [req-0837ca59-e7a8-4d4b-afb2-30d3ab1ddcd4 req-efac8ab0-119d-49a8-b075-5763575b2b48 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-unplugged-cadcfc25-5ade-4259-a3b5-335c9810b29a for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updated VIF entry in instance network info cache for port cadcfc25-5ade-4259-a3b5-335c9810b29a. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG nova.network.neutron [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [{"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:01:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-88a21972-d600-44fb-98d0-2d3b2fa6d3ad req-99a6fff4-477a-4811-a256-fafc45702e01 service nova] Releasing lock "refresh_cache-d7159b6e-90c8-45b1-b918-372a3d2a3965" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Instance destroyed successfully.
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lazy-loading 'resources' on Instance uuid d7159b6e-90c8-45b1-b918-372a3d2a3965 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1026277307',display_name='tempest-TestStampPattern-server-1026277307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1026277307',id=45,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAilulnTAU2Iex7PrVFp/4Hq3bkTpUjS6WOG5Ke1Ts4KRVfb9fsugzZSI6KOwOB9LIGrkUzQRYiwH8mYUvA7MKHsvGFEPYmpiRKUMtU3rJYIJgf/t2zD+ZZoxieq7B7QcQ==',key_name='tempest-TestStampPattern-323340593',keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:55:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6659d659a82341bdb3b54cacf841ae8f',ramdisk_id='',reservation_id='r-6qb4x9te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-799579195',owner_user_name='tempest-TestStampPattern-799579195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:57:55Z,user_data=None,user_id='13e23fd2123c4c238ec7b552a4cf4201',uuid=d7159b6e-90c8-45b1-b918-372a3d2a3965,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converting VIF {"id": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "address": "fa:16:3e:7e:42:2f", "network": {"id": "fa1dc3ca-87d2-4b26-9bda-ae574197b4ca", "bridge": "br-int", "label": "tempest-TestStampPattern-964867457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6659d659a82341bdb3b54cacf841ae8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadcfc25-5a", "ovs_interfaceid": "cadcfc25-5ade-4259-a3b5-335c9810b29a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG os_vif [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcadcfc25-5a, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac85166a-5d80-46ff-ba82-1c39125d97c1) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:01:46 user nova-compute[75409]: INFO os_vif [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:42:2f,bridge_name='br-int',has_traffic_filtering=True,id=cadcfc25-5ade-4259-a3b5-335c9810b29a,network=Network(fa1dc3ca-87d2-4b26-9bda-ae574197b4ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadcfc25-5a')
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Deleting instance files /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965_del
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Deletion of /opt/stack/data/nova/instances/d7159b6e-90c8-45b1-b918-372a3d2a3965_del complete
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.compute.manager [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 22:01:46 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Took 0.38 seconds to deallocate network for instance.
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-525a7c8c-28e0-4010-93a6-9a14636f811c req-eff7521b-69da-4a41-8f03-4115f07f359b service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-deleted-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:01:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:46 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Deleted allocations for instance d7159b6e-90c8-45b1-b918-372a3d2a3965
Nov 15 22:01:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-102cef91-e01d-41fc-831a-1ce8c53eac68 tempest-TestStampPattern-799579195 tempest-TestStampPattern-799579195-project-member] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.582s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:01:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] Acquiring lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] Lock "d7159b6e-90c8-45b1-b918-372a3d2a3965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] No waiting events found dispatching network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:01:48 user nova-compute[75409]: WARNING nova.compute.manager [req-785bb56b-d40a-468c-b2fe-4fed0dab39b8 req-7431a507-ab42-4d2e-8ee9-f34f0cf7c51a service nova] [instance: d7159b6e-90c8-45b1-b918-372a3d2a3965] Received unexpected event network-vif-plugged-cadcfc25-5ade-4259-a3b5-335c9810b29a for instance with vm_state deleted and task_state None.
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:01:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:01:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:05 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:02:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:02:09 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:02:09 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.94896697998047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:02:09 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:02:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:02:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:02:10 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:02:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:02:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:02:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:02:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:02:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:02:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:02:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:03:03 user nova-compute[75409]: INFO nova.compute.claims [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Claim successful on node user
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:03:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.policy [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acbca9cebb9941eb8206ad4aca81cd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2f290e33ee4356a9b192bf4247a641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:03:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Creating image(s)
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:03 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Successfully created port: 6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk 1073741824" returned: 0 in 0.050s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Cannot resize image /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Ensure instance console log exists: /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Successfully updated port: 6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:03:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-changed-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.compute.manager [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Refreshing instance network info cache due to event network-changed-6c49c15b-e299-4c30-95ab-03816527a22b. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] Acquiring lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.neutron [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updating instance_info_cache with network_info: [{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Instance network_info: |[{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] Acquired lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Refreshing network info cache for port 6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Start _get_guest_xml network_info=[{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:03:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:03:05 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293755208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293755208',id=48,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-8y69p0ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:03:04Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=a7967a68-8f2a-46ca-9afd-f1d8d5a65c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.objects.instance [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:03:05 user nova-compute[75409]:   <uuid>a7967a68-8f2a-46ca-9afd-f1d8d5a65c52</uuid>
Nov 15 22:03:05 user nova-compute[75409]:   <name>instance-00000030</name>
Nov 15 22:03:05 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:03:05 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:03:05 user nova-compute[75409]:   <metadata>
Nov 15 22:03:05 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:03:05 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1293755208</nova:name>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:03:05</nova:creationTime>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:03:05 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:03:05 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:owner>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 22:03:05 user nova-compute[75409]:       </nova:owner>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:03:05 user nova-compute[75409]:       <nova:ports>
Nov 15 22:03:05 user nova-compute[75409]:         <nova:port uuid="6c49c15b-e299-4c30-95ab-03816527a22b">
Nov 15 22:03:05 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 22:03:05 user nova-compute[75409]:         </nova:port>
Nov 15 22:03:05 user nova-compute[75409]:       </nova:ports>
Nov 15 22:03:05 user nova-compute[75409]:     </nova:instance>
Nov 15 22:03:05 user nova-compute[75409]:   </metadata>
Nov 15 22:03:05 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:03:05 user nova-compute[75409]:     <system>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="serial">a7967a68-8f2a-46ca-9afd-f1d8d5a65c52</entry>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="uuid">a7967a68-8f2a-46ca-9afd-f1d8d5a65c52</entry>
Nov 15 22:03:05 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:03:05 user nova-compute[75409]:     </system>
Nov 15 22:03:05 user nova-compute[75409]:   </sysinfo>
Nov 15 22:03:05 user nova-compute[75409]:   <os>
Nov 15 22:03:05 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:03:05 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:03:05 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:03:05 user nova-compute[75409]:   </os>
Nov 15 22:03:05 user nova-compute[75409]:   <features>
Nov 15 22:03:05 user nova-compute[75409]:     <acpi/>
Nov 15 22:03:05 user nova-compute[75409]:     <apic/>
Nov 15 22:03:05 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:03:05 user nova-compute[75409]:   </features>
Nov 15 22:03:05 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:03:05 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:03:05 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:03:05 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:03:05 user nova-compute[75409]:   </clock>
Nov 15 22:03:05 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:03:05 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:03:05 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:03:05 user nova-compute[75409]:   </cpu>
Nov 15 22:03:05 user nova-compute[75409]:   <devices>
Nov 15 22:03:05 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:03:05 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:03:05 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk"/>
Nov 15 22:03:05 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:03:05 user nova-compute[75409]:     </disk>
Nov 15 22:03:05 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:03:05 user nova-compute[75409]:       <mac address="fa:16:3e:58:a4:b0"/>
Nov 15 22:03:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:03:05 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:03:05 user nova-compute[75409]:       <target dev="tap6c49c15b-e2"/>
Nov 15 22:03:05 user nova-compute[75409]:     </interface>
Nov 15 22:03:05 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:03:05 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/console.log" append="off"/>
Nov 15 22:03:05 user nova-compute[75409]:     </serial>
Nov 15 22:03:05 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:03:05 user nova-compute[75409]:     <video>
Nov 15 22:03:05 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:03:05 user nova-compute[75409]:     </video>
Nov 15 22:03:05 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:03:05 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:03:05 user nova-compute[75409]:     </rng>
Nov 15 22:03:05 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:03:05 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:03:05 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:03:05 user nova-compute[75409]:     </memballoon>
Nov 15 22:03:05 user nova-compute[75409]:   </devices>
Nov 15 22:03:05 user nova-compute[75409]: </domain>
Nov 15 22:03:05 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293755208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293755208',id=48,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-8y69p0ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:03:04Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=a7967a68-8f2a-46ca-9afd-f1d8d5a65c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG os_vif [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5655e759-18c2-5ff8-adf7-ebe38fa12b95', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c49c15b-e2, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c49c15b-e2, col_values=(('qos', UUID('c34d30ce-b7d5-47b0-8170-07256097339e')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c49c15b-e2, col_values=(('external_ids', {'iface-id': '6c49c15b-e299-4c30-95ab-03816527a22b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:a4:b0', 'vm-uuid': 'a7967a68-8f2a-46ca-9afd-f1d8d5a65c52'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:05 user nova-compute[75409]: INFO os_vif [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2')
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:58:a4:b0, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updated VIF entry in instance network info cache for port 6c49c15b-e299-4c30-95ab-03816527a22b. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG nova.network.neutron [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updating instance_info_cache with network_info: [{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:03:05 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-561ee16f-b352-46f1-bbc6-ea128986fb22 req-418410df-d6e9-4e9b-bce7-cf955eaac741 service nova] Releasing lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] No waiting events found dispatching network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:03:07 user nova-compute[75409]: WARNING nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received unexpected event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b for instance with vm_state building and task_state spawning.
Nov 15 22:03:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] No waiting events found dispatching network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:03:07 user nova-compute[75409]: WARNING nova.compute.manager [req-919923fe-1ffc-41b8-9b62-bd312aa65e30 req-02e446c0-e5db-4b76-b5d9-a8cc53b06dc4 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received unexpected event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b for instance with vm_state building and task_state spawning.
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:03:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Instance spawned successfully.
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:03:08 user nova-compute[75409]: INFO nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 22:03:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:03:08 user nova-compute[75409]: INFO nova.compute.manager [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Took 5.62 seconds to build instance.
Nov 15 22:03:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-cebc4b3d-11bb-4f7a-8429-94456ff0c10c tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.716s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:03:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:03:11 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:03:11 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=24.945865631103516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:03:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:03:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:03:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:06 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:06 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:10 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:11 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:04:11 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.909656524658203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:04:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:04:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:04:54 user nova-compute[75409]: INFO nova.compute.manager [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] instance snapshotting
Nov 15 22:04:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Beginning live snapshot process
Nov 15 22:04:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json -f qcow2 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950.delta 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950.delta 1073741824" returned: 0 in 0.047s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:55 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:04:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 22:04:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] COPY block job progress, current cursor: 75169792 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 22:04:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 22:04:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 22:04:57 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 22:04:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950.delta /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:04:57 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950.delta /opt/stack/data/nova/instances/snapshots/tmp71aua_n2/645e923008884be39782592ab8b1d950" returned: 0 in 0.325s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:04:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Snapshot extracted, beginning image upload
Nov 15 22:04:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Snapshot image upload complete
Nov 15 22:04:59 user nova-compute[75409]: INFO nova.compute.manager [None req-f4275614-946a-44d7-a597-a363995dc028 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Took 5.39 seconds to snapshot the instance on the hypervisor.
Nov 15 22:05:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:08 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:05:11 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:05:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:05:12 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.86011505126953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:05:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:05:14 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:05:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:05:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:06:02 user nova-compute[75409]: INFO nova.compute.claims [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Claim successful on node user
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:06:02 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:06:02 user nova-compute[75409]: DEBUG nova.policy [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acbca9cebb9941eb8206ad4aca81cd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2f290e33ee4356a9b192bf4247a641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:06:02 user nova-compute[75409]: INFO nova.virt.block_device [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Booting with volume-backed-image 76e2224a-f851-4f51-8b88-3264d76e2cea at /dev/vda
Nov 15 22:06:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Successfully created port: 29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Successfully updated port: 29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-changed-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Refreshing instance network info cache due to event network-changed-29609708-9050-4104-af16-f066dfff35fb. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] Acquiring lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:06:03 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG nova.network.neutron [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance network_info: |[{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] Acquired lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Refreshing network info cache for port 29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updated VIF entry in instance network info cache for port 29609708-9050-4104-af16-f066dfff35fb. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG nova.network.neutron [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:06:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cf8aa90-88a0-4871-bc50-ac18d0aee0ae req-2955d0c4-4840-4ac7-b75f-1f88e95cdeea service nova] Releasing lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:06:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8671d-062b-4719-b874-db73f6aec786]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6401e-e4a7-4a01-9468-1329d889afe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf97d64-04ab-4e5d-baba-da035a9ccacf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a1627-92a7-4ca3-880b-3fc5fd840414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:06:08 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 22:06:08 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71785c5-f9a5-4b28-9c38-5022e47fe4d6]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG os_brick.utils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:06:08 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating existing volume attachment record: 9262366b-6d19-4db4-ac65-1af76816dfd0 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 22:06:10 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:06:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:06:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=24.859149932861328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:06:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Creating image(s)
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Did not create local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Ensure instance console log exists: /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start _get_guest_xml network_info=[{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34a2b99c-5aa3-4d89-bb66-4a69d71de1cd', 'attached_at': '', 'detached_at': '', 'volume_id': '2d5d4700-733b-497f-aa3e-85870536712c', 'serial': '2d5d4700-733b-497f-aa3e-85870536712c'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '9262366b-6d19-4db4-ac65-1af76816dfd0', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:06:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:06:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:06:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:06:13 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:06:13 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c6c878-d900-40a4-81d6-e24c845881de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 22:06:13 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4230bc-328f-4266-b344-a4d66415e582]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c] added
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca8714-8341-4a42-af4a-1d96aba1410c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ab099-6ab5-4510-a86a-4b0f644db020]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqBDAMGp {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqBDAMGp" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64aec39-99be-4fc5-b89f-2d2f8cab97e6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqBDAMGp'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16a923-f2e7-4cbb-aa0b-b90b61e6373a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d10b3-8d7c-4d9e-992d-fcdc5f078a0a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b4777-71a0-4d25-bf8f-c1d63c926081]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260]
Nov 15 22:06:13 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260] successful.
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[840182fa-a948-4a15-acdc-07c438f8d23f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7eef01-9313-4418-a9eb-2123afeaa68f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:06:13 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:06:13 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:06:13 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d603e3-b514-4254-b936-9ec7bf832cfd]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:06:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26332613164616365', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613164616365', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347610350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347610350',id=49,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-j5qgex8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:06:03Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=34a2b99c-5aa3-4d89-bb66-4a69d71de1cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.objects.instance [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:06:14 user nova-compute[75409]:   <uuid>34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</uuid>
Nov 15 22:06:14 user nova-compute[75409]:   <name>instance-00000031</name>
Nov 15 22:06:14 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:06:14 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:06:14 user nova-compute[75409]:   <metadata>
Nov 15 22:06:14 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:06:14 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-347610350</nova:name>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:06:13</nova:creationTime>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:06:14 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:06:14 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:owner>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 22:06:14 user nova-compute[75409]:       </nova:owner>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:06:14 user nova-compute[75409]:       <nova:ports>
Nov 15 22:06:14 user nova-compute[75409]:         <nova:port uuid="29609708-9050-4104-af16-f066dfff35fb">
Nov 15 22:06:14 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 22:06:14 user nova-compute[75409]:         </nova:port>
Nov 15 22:06:14 user nova-compute[75409]:       </nova:ports>
Nov 15 22:06:14 user nova-compute[75409]:     </nova:instance>
Nov 15 22:06:14 user nova-compute[75409]:   </metadata>
Nov 15 22:06:14 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:06:14 user nova-compute[75409]:     <system>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="serial">34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</entry>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="uuid">34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</entry>
Nov 15 22:06:14 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:06:14 user nova-compute[75409]:     </system>
Nov 15 22:06:14 user nova-compute[75409]:   </sysinfo>
Nov 15 22:06:14 user nova-compute[75409]:   <os>
Nov 15 22:06:14 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:06:14 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:06:14 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:06:14 user nova-compute[75409]:   </os>
Nov 15 22:06:14 user nova-compute[75409]:   <features>
Nov 15 22:06:14 user nova-compute[75409]:     <acpi/>
Nov 15 22:06:14 user nova-compute[75409]:     <apic/>
Nov 15 22:06:14 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:06:14 user nova-compute[75409]:   </features>
Nov 15 22:06:14 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:06:14 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:06:14 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:06:14 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:06:14 user nova-compute[75409]:   </clock>
Nov 15 22:06:14 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:06:14 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:06:14 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:06:14 user nova-compute[75409]:   </cpu>
Nov 15 22:06:14 user nova-compute[75409]:   <devices>
Nov 15 22:06:14 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 22:06:14 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:06:14 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 22:06:14 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:06:14 user nova-compute[75409]:       <serial>2d5d4700-733b-497f-aa3e-85870536712c</serial>
Nov 15 22:06:14 user nova-compute[75409]:     </disk>
Nov 15 22:06:14 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:06:14 user nova-compute[75409]:       <mac address="fa:16:3e:72:43:6b"/>
Nov 15 22:06:14 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:06:14 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:06:14 user nova-compute[75409]:       <target dev="tap29609708-90"/>
Nov 15 22:06:14 user nova-compute[75409]:     </interface>
Nov 15 22:06:14 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:06:14 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/console.log" append="off"/>
Nov 15 22:06:14 user nova-compute[75409]:     </serial>
Nov 15 22:06:14 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:06:14 user nova-compute[75409]:     <video>
Nov 15 22:06:14 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:06:14 user nova-compute[75409]:     </video>
Nov 15 22:06:14 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:06:14 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:06:14 user nova-compute[75409]:     </rng>
Nov 15 22:06:14 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:06:14 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:06:14 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:06:14 user nova-compute[75409]:     </memballoon>
Nov 15 22:06:14 user nova-compute[75409]:   </devices>
Nov 15 22:06:14 user nova-compute[75409]: </domain>
Nov 15 22:06:14 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347610350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347610350',id=49,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-j5qgex8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:06:03Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=34a2b99c-5aa3-4d89-bb66-4a69d71de1cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG os_vif [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c1dd6b9-f1fa-56b3-8068-76eb149276f5', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29609708-90, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29609708-90, col_values=(('qos', UUID('032c8527-d34c-4348-984b-ca14845afec5')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29609708-90, col_values=(('external_ids', {'iface-id': '29609708-9050-4104-af16-f066dfff35fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:43:6b', 'vm-uuid': '34a2b99c-5aa3-4d89-bb66-4a69d71de1cd'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:14 user nova-compute[75409]: INFO os_vif [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90')
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:06:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:72:43:6b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:06:15 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:15 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:06:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:06:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:06:15 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updating instance_info_cache with network_info: [{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:06:16 user nova-compute[75409]: WARNING nova.compute.manager [req-2a4f6e6a-e3ce-457f-aeaa-bd709d1b176d req-3347b223-8d8d-496c-8370-a22852a045ba service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state building and task_state spawning.
Nov 15 22:06:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:06:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance spawned successfully.
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:06:18 user nova-compute[75409]: WARNING nova.compute.manager [req-0f009c9c-5645-49c5-bad8-378fb329fc26 req-9ee3ad5d-23b3-4e14-957f-709f5ace5476 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state building and task_state spawning.
Nov 15 22:06:18 user nova-compute[75409]: INFO nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 15 22:06:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:06:18 user nova-compute[75409]: INFO nova.compute.manager [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Took 16.49 seconds to build instance.
Nov 15 22:06:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-58e2e572-dc85-4448-9389-2019bbe65712 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.592s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:06:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:06:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:06:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:06:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:12 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:07:13 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=24.857769012451172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:07:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:07:16 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:17 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:07:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:07:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:07:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:07:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:07:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:07:53 user nova-compute[75409]: INFO nova.compute.manager [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Rescuing
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:07:53 user nova-compute[75409]: WARNING nova.compute.manager [req-55094442-b7e1-41ec-b7cd-68318e41fc67 req-9909775e-1987-4ed6-97a8-d1f22e96b149 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state rescuing.
Nov 15 22:07:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance destroyed successfully.
Nov 15 22:07:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Attempting a stable device rescue
Nov 15 22:07:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance directory exists: not creating {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 22:07:54 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Creating image(s)
Nov 15 22:07:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "1751ef7758df75f23609bba927155f5349a47378" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "1751ef7758df75f23609bba927155f5349a47378" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.part --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.part --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG nova.virt.images [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] 049239a2-c56d-4da7-b2ee-dbd79f3a4c5d was qcow2, converting to raw {{(pid=75409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG nova.privsep.utils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.part /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.converted {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.part /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.converted" returned: 0 in 0.329s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.converted --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:07:55 user nova-compute[75409]: WARNING nova.compute.manager [req-53c861c4-3d9f-42ee-9fdf-a9eafdafb38d req-ede9cb03-9889-4159-936a-d775ab3cc001 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state rescuing.
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "1751ef7758df75f23609bba927155f5349a47378" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.583s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "1751ef7758df75f23609bba927155f5349a47378" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "1751ef7758df75f23609bba927155f5349a47378" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378 --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378,backing_fmt=raw /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1751ef7758df75f23609bba927155f5349a47378,backing_fmt=raw /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue" returned: 0 in 0.048s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "1751ef7758df75f23609bba927155f5349a47378" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'migration_context' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<34a2b99c-5aa3-4d89-bb66-4a69d71de1cd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start _get_guest_xml network_info=[{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:72:43:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '049239a2-c56d-4da7-b2ee-dbd79f3a4c5d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '34a2b99c-5aa3-4d89-bb66-4a69d71de1cd', 'attached_at': '', 'detached_at': '', 'volume_id': '2d5d4700-733b-497f-aa3e-85870536712c', 'serial': '2d5d4700-733b-497f-aa3e-85870536712c'}, 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '9262366b-6d19-4db4-ac65-1af76816dfd0', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<34a2b99c-5aa3-4d89-bb66-4a69d71de1cd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'numa_topology' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<34a2b99c-5aa3-4d89-bb66-4a69d71de1cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 22:07:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:07:56 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<34a2b99c-5aa3-4d89-bb66-4a69d71de1cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:07:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:07:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:07:56 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bc9a9-8950-4dd6-b061-89b79bb0dcdc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bqBDAMGp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 22:07:56 user nova-compute[75409]: node.name = iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c
Nov 15 22:07:56 user nova-compute[75409]: node.tpgt = -1
Nov 15 22:07:56 user nova-compute[75409]: node.startup = automatic
Nov 15 22:07:56 user nova-compute[75409]: node.leading_login = No
Nov 15 22:07:56 user nova-compute[75409]: iface.iscsi_ifacename = default
Nov 15 22:07:56 user nova-compute[75409]: iface.net_ifacename = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.ipaddress = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.prefix_len = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.hwaddress = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.transport_name = tcp
Nov 15 22:07:56 user nova-compute[75409]: iface.initiatorname = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.vlan_id = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.vlan_priority = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.vlan_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.iface_num = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.mtu = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.port = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.bootproto = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.subnet_mask = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.gateway = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_alt_client_id = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_dns = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_learn_iqn = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_vendor_id_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_vendor_id = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.dhcp_slp_da = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.fragmentation = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.gratuitous_arp = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.incoming_forwarding = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.tos_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.tos = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.ttl = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.delayed_ack = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.tcp_nagle = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.tcp_wsf_state = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.tcp_wsf = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.tcp_timer_scale = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.tcp_timestamp = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.redirect = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.def_task_mgmt_timeout = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.header_digest = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.data_digest = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.immediate_data = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.initial_r2t = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.data_seq_inorder = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.data_pdu_inorder = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.erl = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.max_receive_data_len = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.first_burst_len = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.max_outstanding_r2t = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.max_burst_len = 0
Nov 15 22:07:56 user nova-compute[75409]: iface.chap_auth = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.bidi_chap = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.strict_login_compliance = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.discovery_auth = <empty>
Nov 15 22:07:56 user nova-compute[75409]: iface.discovery_logout = <empty>
Nov 15 22:07:56 user nova-compute[75409]: node.discovery_address = <empty>
Nov 15 22:07:56 user nova-compute[75409]: node.discovery_port = 0
Nov 15 22:07:56 user nova-compute[75409]: node.discovery_type = static
Nov 15 22:07:56 user nova-compute[75409]: node.session.initial_cmdsn = 0
Nov 15 22:07:56 user nova-compute[75409]: node.session.initial_login_retry_max = 8
Nov 15 22:07:56 user nova-compute[75409]: node.session.xmit_thread_priority = -20
Nov 15 22:07:56 user nova-compute[75409]: node.session.cmds_max = 128
Nov 15 22:07:56 user nova-compute[75409]: node.session.queue_depth = 32
Nov 15 22:07:56 user nova-compute[75409]: node.session.nr_sessions = 1
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.authmethod = CHAP
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.username = bqBDAMGp
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.password = ***
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.username_in = <empty>
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.password_in = <empty>
Nov 15 22:07:56 user nova-compute[75409]: node.session.auth.chap_algs = MD5
Nov 15 22:07:56 user nova-compute[75409]: node.session.timeo.replacement_timeout = 120
Nov 15 22:07:56 user nova-compute[75409]: node.session.err_timeo.abort_timeout = 15
Nov 15 22:07:56 user nova-compute[75409]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 22:07:56 user nova-compute[75409]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 22:07:56 user nova-compute[75409]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.FastAbort = Yes
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.InitialR2T = No
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.ImmediateData = Yes
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.MaxConnections = 1
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 22:07:56 user nova-compute[75409]: node.session.iscsi.ERL = 0
Nov 15 22:07:56 user nova-compute[75409]: node.session.scan = manual
Nov 15 22:07:56 user nova-compute[75409]: node.session.reopen_max = 0
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].address = 172.16.0.220
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].port = 3260
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].startup = manual
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].tcp.window_size = 524288
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].tcp.type_of_service = 0
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].timeo.logout_timeout = 15
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].timeo.login_timeout = 15
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].timeo.auth_timeout = 45
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.DataDigest = None
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.IFMarker = No
Nov 15 22:07:56 user nova-compute[75409]: node.conn[0].iscsi.OFMarker = No
Nov 15 22:07:56 user nova-compute[75409]: # END RECORD
Nov 15 22:07:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ab4e7b-2495-4693-90d5-9be609c83988]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0195b9a9-87eb-4966-bbf8-09aea0d0d365]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqBDAMGp {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqBDAMGp" returned: 0 in 0.024s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1987d-5e84-41b8-8528-02632bfa6d9c]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqBDAMGp'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b5f2a-090f-4927-9531-c60a5d52152e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da30f65-c30c-4fe4-b840-b09c37c7b631]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:07:56 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:07:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:07:56 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:07:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.192s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] HCTL ('34', '0', '0', 0) found on session 63 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d354e811-32f4-4d02-a456-c92b0667ce1a]: (4, ('0 0 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Searching for a device in session 63 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.216s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== connect_volume: return (218ms) {'type': 'block', 'scsi_wwn': '26332613164616365', 'path': '/dev/sdc'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613164616365', 'path': '/dev/sdc'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347610350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347610350',id=49,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-j5qgex8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:06:19Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=34a2b99c-5aa3-4d89-bb66-4a69d71de1cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:72:43:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "vif_mac": "fa:16:3e:72:43:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.instance [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'pci_devices' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.objects.base [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Object Instance<34a2b99c-5aa3-4d89-bb66-4a69d71de1cd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75409) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:07:56 user nova-compute[75409]:   <uuid>34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</uuid>
Nov 15 22:07:56 user nova-compute[75409]:   <name>instance-00000031</name>
Nov 15 22:07:56 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:07:56 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:07:56 user nova-compute[75409]:   <metadata>
Nov 15 22:07:56 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:07:56 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-347610350</nova:name>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:07:56</nova:creationTime>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:07:56 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:07:56 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:owner>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:user uuid="acbca9cebb9941eb8206ad4aca81cd96">tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member</nova:user>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:project uuid="2e2f290e33ee4356a9b192bf4247a641">tempest-ServerBootFromVolumeStableRescueTest-283656267</nova:project>
Nov 15 22:07:56 user nova-compute[75409]:       </nova:owner>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:07:56 user nova-compute[75409]:       <nova:ports>
Nov 15 22:07:56 user nova-compute[75409]:         <nova:port uuid="29609708-9050-4104-af16-f066dfff35fb">
Nov 15 22:07:56 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 22:07:56 user nova-compute[75409]:         </nova:port>
Nov 15 22:07:56 user nova-compute[75409]:       </nova:ports>
Nov 15 22:07:56 user nova-compute[75409]:     </nova:instance>
Nov 15 22:07:56 user nova-compute[75409]:   </metadata>
Nov 15 22:07:56 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:07:56 user nova-compute[75409]:     <system>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="serial">34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</entry>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="uuid">34a2b99c-5aa3-4d89-bb66-4a69d71de1cd</entry>
Nov 15 22:07:56 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:07:56 user nova-compute[75409]:     </system>
Nov 15 22:07:56 user nova-compute[75409]:   </sysinfo>
Nov 15 22:07:56 user nova-compute[75409]:   <os>
Nov 15 22:07:56 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:07:56 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:07:56 user nova-compute[75409]:   </os>
Nov 15 22:07:56 user nova-compute[75409]:   <features>
Nov 15 22:07:56 user nova-compute[75409]:     <acpi/>
Nov 15 22:07:56 user nova-compute[75409]:     <apic/>
Nov 15 22:07:56 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:07:56 user nova-compute[75409]:   </features>
Nov 15 22:07:56 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:07:56 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:07:56 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:07:56 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:07:56 user nova-compute[75409]:   </clock>
Nov 15 22:07:56 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:07:56 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:07:56 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:07:56 user nova-compute[75409]:   </cpu>
Nov 15 22:07:56 user nova-compute[75409]:   <devices>
Nov 15 22:07:56 user nova-compute[75409]:     <disk type="block" device="disk">
Nov 15 22:07:56 user nova-compute[75409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:07:56 user nova-compute[75409]:       <source dev="/dev/sdc"/>
Nov 15 22:07:56 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:07:56 user nova-compute[75409]:       <serial>2d5d4700-733b-497f-aa3e-85870536712c</serial>
Nov 15 22:07:56 user nova-compute[75409]:     </disk>
Nov 15 22:07:56 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:07:56 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:07:56 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue"/>
Nov 15 22:07:56 user nova-compute[75409]:       <target dev="vdb" bus="virtio"/>
Nov 15 22:07:56 user nova-compute[75409]:       <boot order="1"/>
Nov 15 22:07:56 user nova-compute[75409]:     </disk>
Nov 15 22:07:56 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:07:56 user nova-compute[75409]:       <mac address="fa:16:3e:72:43:6b"/>
Nov 15 22:07:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:07:56 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:07:56 user nova-compute[75409]:       <target dev="tap29609708-90"/>
Nov 15 22:07:56 user nova-compute[75409]:     </interface>
Nov 15 22:07:56 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:07:56 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/console.log" append="off"/>
Nov 15 22:07:56 user nova-compute[75409]:     </serial>
Nov 15 22:07:56 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:07:56 user nova-compute[75409]:     <video>
Nov 15 22:07:56 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:07:56 user nova-compute[75409]:     </video>
Nov 15 22:07:56 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:07:56 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:07:56 user nova-compute[75409]:     </rng>
Nov 15 22:07:56 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:07:56 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:07:56 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:07:56 user nova-compute[75409]:     </memballoon>
Nov 15 22:07:56 user nova-compute[75409]:   </devices>
Nov 15 22:07:56 user nova-compute[75409]: </domain>
Nov 15 22:07:56 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:07:56 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance destroyed successfully.
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:07:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] No VIF found with MAC fa:16:3e:72:43:6b, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:07:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:07:58 user nova-compute[75409]: WARNING nova.compute.manager [req-ddc36800-4e8f-412a-89c4-3ec3eda779a9 req-688506f5-4827-4358-bc29-24eb0d701d1f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state rescuing.
Nov 15 22:07:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG nova.compute.manager [None req-0afd82cd-db86-4a72-8667-78910932dbae tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG nova.compute.manager [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:08:00 user nova-compute[75409]: WARNING nova.compute.manager [req-4236f4ad-0a9c-438a-a16f-ecb5f9df661f req-c197d91a-92fb-48bb-9ca7-2032ac562b88 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state rescuing.
Nov 15 22:08:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:08:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:08:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=24.76142120361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:08:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:08:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:08:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:08:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:08:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:08:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:08:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:09:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:09:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:09:14 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:09:15 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=24.760234832763672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:09:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:09:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updating instance_info_cache with network_info: [{"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:09:18 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:09:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:09:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:43 user nova-compute[75409]: INFO nova.compute.manager [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Unrescuing
Nov 15 22:09:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:09:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquired lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:09:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Releasing lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'flavor' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:09:44 user nova-compute[75409]: WARNING nova.compute.manager [req-2cbf07ac-66b4-43e3-ad30-e4c93fff1b5a req-9260706e-c6c4-4a77-bb73-293d93e0b947 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:09:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:45 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance destroyed successfully.
Nov 15 22:09:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:09:46 user nova-compute[75409]: WARNING nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:09:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:46 user nova-compute[75409]: DEBUG nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:09:46 user nova-compute[75409]: WARNING nova.compute.manager [req-e7f90f50-8ddb-4e6e-b44d-a1e389b532a3 req-55680f0c-53bd-4379-9002-3f8b4dc3fec7 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state rescued and task_state unrescuing.
Nov 15 22:09:48 user nova-compute[75409]: DEBUG nova.compute.manager [None req-4a523750-0c54-47aa-a472-4cd170e4eb1a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:09:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:09:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:09:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:09:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:09:48 user nova-compute[75409]: DEBUG nova.compute.manager [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:09:48 user nova-compute[75409]: WARNING nova.compute.manager [req-00223287-e481-4606-aac2-eb3673410a46 req-d1515f2b-1ae0-44da-ae3a-563ff371189f service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state None.
Nov 15 22:09:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:09:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:10:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:10:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:10:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:10:17 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=24.760425567626953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:10:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:10:20 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [{"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:10:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:10:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:18 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:11:18 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=24.759849548339844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:11:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:11:21 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:11:22 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [{"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:11:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-f62194e4-7efa-44b1-a55a-8ac3cbd34c70" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:11:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:11:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:11:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:11:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:11:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:34 user nova-compute[75409]: INFO nova.compute.manager [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Terminating instance
Nov 15 22:11:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.compute.manager [req-260406bc-8622-4af9-a635-a98d5d41d65e req-b2c92efa-4461-4436-8d0a-0330577b0a6d service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-unplugged-29609708-9050-4104-af16-f066dfff35fb for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Instance destroyed successfully.
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347610350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347610350',id=49,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-j5qgex8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:09:48Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=34a2b99c-5aa3-4d89-bb66-4a69d71de1cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "29609708-9050-4104-af16-f066dfff35fb", "address": "fa:16:3e:72:43:6b", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29609708-90", "ovs_interfaceid": "29609708-9050-4104-af16-f066dfff35fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_vif [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29609708-90, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=032c8527-d34c-4348-984b-ca14845afec5) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:35 user nova-compute[75409]: INFO os_vif [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:43:6b,bridge_name='br-int',has_traffic_filtering=True,id=29609708-9050-4104-af16-f066dfff35fb,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29609708-90')
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqBDAMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:11:35 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e731e-ea12-4043-988a-47e8220a0681]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:11:35 user nova-compute[75409]: No targets found.
Nov 15 22:11:35 user nova-compute[75409]: iSNS:
Nov 15 22:11:35 user nova-compute[75409]: No targets found.
Nov 15 22:11:35 user nova-compute[75409]: STATIC:
Nov 15 22:11:35 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6
Nov 15 22:11:35 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:11:35 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:11:35 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c
Nov 15 22:11:35 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:11:35 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:11:35 user nova-compute[75409]: FIRMWARE:
Nov 15 22:11:35 user nova-compute[75409]: No targets found.
Nov 15 22:11:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:11:35 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:11:35 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[67454bc1-f009-439c-814e-112072b16812]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b5eab-1d20-4f8c-b370-0e732beef965]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:11:35 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:11:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:11:35 user nova-compute[75409]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c (non-flash)
Nov 15 22:11:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf086be5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c'): ({'sdc'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Removing single pathed devices sdc {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a693e65a-4354-4fe4-bf52-cfd37b44455c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918e476-9f2b-49a5-b839-86292f5da1ae]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flushing IO for device /dev/sdc {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1de3fef-c9ee-4f03-91d8-13f9c3a47c24]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aca105-2b2d-4372-9219-4ce646b9c63e]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] SCSI volumes sdc have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b21c2dc-c25f-4cb6-8a0e-4d2495c5d94e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58e9d5-0353-4f67-9c2e-6514d6644684]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260]
Nov 15 22:11:35 user nova-compute[75409]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c, portal: 172.16.0.220,3260] successful.
Nov 15 22:11:35 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d5d4700-733b-497f-aa3e-85870536712c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc3897-5ddd-406d-bdd3-6cfd8b2d63b3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== disconnect_volume: return (313ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:11:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Deleting instance files /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd_del
Nov 15 22:11:35 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Deletion of /opt/stack/data/nova/instances/34a2b99c-5aa3-4d89-bb66-4a69d71de1cd_del complete
Nov 15 22:11:35 user nova-compute[75409]: INFO nova.compute.manager [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 22:11:35 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:11:35 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:11:36 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:11:36 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Took 0.41 seconds to deallocate network for instance.
Nov 15 22:11:36 user nova-compute[75409]: DEBUG nova.compute.manager [req-6eaca646-9705-4a60-86c3-5f4841b22715 req-7d2557c5-e942-477c-babf-e7fddad3c51c service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-deleted-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] Acquiring lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] No waiting events found dispatching network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:11:37 user nova-compute[75409]: WARNING nova.compute.manager [req-76fdcbb9-c0c0-4103-8fef-3141cfb59ef9 req-76fde977-87f1-45d1-92e7-ff230ac8cf85 service nova] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Received unexpected event network-vif-plugged-29609708-9050-4104-af16-f066dfff35fb for instance with vm_state active and task_state deleting.
Nov 15 22:11:37 user nova-compute[75409]: INFO nova.compute.manager [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd] Took 0.86 seconds to detach 1 volumes for instance.
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:37 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Deleted allocations for instance 34a2b99c-5aa3-4d89-bb66-4a69d71de1cd
Nov 15 22:11:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d2e29129-c7a2-4973-b419-8f238f80425f tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "34a2b99c-5aa3-4d89-bb66-4a69d71de1cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:11:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:11:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:11:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:11:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:12:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:12:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:12:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.759014129638672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance d420ec12-97e3-4b89-ac7d-f29965223e73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:12:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:12:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [{"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-d420ec12-97e3-4b89-ac7d-f29965223e73" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:12:22 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:12:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:25 user nova-compute[75409]: INFO nova.compute.manager [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Terminating instance
Nov 15 22:12:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-unplugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] No waiting events found dispatching network-vif-unplugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG nova.compute.manager [req-614832e6-4710-4bec-a911-8461f4abc39e req-d2ea95b3-c01f-416c-b887-75b6a29f5067 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-unplugged-6c49c15b-e299-4c30-95ab-03816527a22b for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:12:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Instance destroyed successfully.
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid a7967a68-8f2a-46ca-9afd-f1d8d5a65c52 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1293755208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1293755208',id=48,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-8y69p0ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:05:00Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=a7967a68-8f2a-46ca-9afd-f1d8d5a65c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "6c49c15b-e299-4c30-95ab-03816527a22b", "address": "fa:16:3e:58:a4:b0", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c49c15b-e2", "ovs_interfaceid": "6c49c15b-e299-4c30-95ab-03816527a22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG os_vif [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c49c15b-e2, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c34d30ce-b7d5-47b0-8170-07256097339e) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:26 user nova-compute[75409]: INFO os_vif [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:a4:b0,bridge_name='br-int',has_traffic_filtering=True,id=6c49c15b-e299-4c30-95ab-03816527a22b,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c49c15b-e2')
Nov 15 22:12:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Deleting instance files /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52_del
Nov 15 22:12:26 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Deletion of /opt/stack/data/nova/instances/a7967a68-8f2a-46ca-9afd-f1d8d5a65c52_del complete
Nov 15 22:12:26 user nova-compute[75409]: INFO nova.compute.manager [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 22:12:26 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:12:26 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Took 0.59 seconds to deallocate network for instance.
Nov 15 22:12:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:27 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Deleted allocations for instance a7967a68-8f2a-46ca-9afd-f1d8d5a65c52
Nov 15 22:12:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9bdc8eca-dfe8-4b65-a0da-1982d692b636 tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] Acquiring lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] Lock "a7967a68-8f2a-46ca-9afd-f1d8d5a65c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:12:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] No waiting events found dispatching network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:12:27 user nova-compute[75409]: WARNING nova.compute.manager [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received unexpected event network-vif-plugged-6c49c15b-e299-4c30-95ab-03816527a22b for instance with vm_state deleted and task_state None.
Nov 15 22:12:27 user nova-compute[75409]: DEBUG nova.compute.manager [req-a9e0086e-5386-4a1f-8774-55a36bfff0ee req-e1b50604-ad45-419e-b2d4-594e99e78e99 service nova] [instance: a7967a68-8f2a-46ca-9afd-f1d8d5a65c52] Received event network-vif-deleted-6c49c15b-e299-4c30-95ab-03816527a22b {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:12:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:12:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:12:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:12:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:13:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:16 user nova-compute[75409]: INFO nova.compute.manager [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Terminating instance
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.compute.manager [req-34e8b8a8-de2e-430f-ac33-f68c1bdbdb30 req-d04fbc81-c5a8-4e30-8ee9-26ea8922c4f2 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-unplugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Instance destroyed successfully.
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid d420ec12-97e3-4b89-ac7d-f29965223e73 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1161970609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1161970609',id=46,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-wioz7maa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:01:16Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=d420ec12-97e3-4b89-ac7d-f29965223e73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "ec4c1738-4831-429b-aef9-db1ae28302d5", "address": "fa:16:3e:0a:87:0c", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4c1738-48", "ovs_interfaceid": "ec4c1738-4831-429b-aef9-db1ae28302d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG os_vif [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4c1738-48, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ba86832-7699-4a3b-baef-1e95d7634f2f) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:16 user nova-compute[75409]: INFO os_vif [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:87:0c,bridge_name='br-int',has_traffic_filtering=True,id=ec4c1738-4831-429b-aef9-db1ae28302d5,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4c1738-48')
Nov 15 22:13:16 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFWjnuTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:13:16 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:13:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:13:16 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2952e3ae-35dd-4c9e-bbb2-21e6bb6b3b37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:13:17 user nova-compute[75409]: No targets found.
Nov 15 22:13:17 user nova-compute[75409]: iSNS:
Nov 15 22:13:17 user nova-compute[75409]: No targets found.
Nov 15 22:13:17 user nova-compute[75409]: STATIC:
Nov 15 22:13:17 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6
Nov 15 22:13:17 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:13:17 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:13:17 user nova-compute[75409]: FIRMWARE:
Nov 15 22:13:17 user nova-compute[75409]: No targets found.
Nov 15 22:13:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:13:17 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:13:17 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f346f4e-d71d-4a8d-b0c9-561a6a979084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8329d0-0d5b-43c5-9b08-c9bbb1652736]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:13:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 (non-flash)
Nov 15 22:13:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf086955a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b0229-e5e4-4de1-b131-30f699ee67ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e4aa23-6154-47c3-bf06-da9d8b3cb26c]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761067b-eb22-416a-a926-85445d6233c1]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31d570-5079-40a8-ae3e-91bbfac56ada]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028ac44-3b2d-4454-8e7f-2e2b8ae3e012]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ea3b9-447d-4838-9151-41bf0f69f623]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260]
Nov 15 22:13:17 user nova-compute[75409]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6, portal: 172.16.0.220,3260] successful.
Nov 15 22:13:17 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbafea49-58d1-471d-96dc-b43d3b2d12f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1247f4ac-0dfc-465e-b171-fc13e5b40c5e]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] <== disconnect_volume: return (297ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:13:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Deleting instance files /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73_del
Nov 15 22:13:17 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Deletion of /opt/stack/data/nova/instances/d420ec12-97e3-4b89-ac7d-f29965223e73_del complete
Nov 15 22:13:17 user nova-compute[75409]: INFO nova.compute.manager [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 22:13:17 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:13:17 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Took 0.56 seconds to deallocate network for instance.
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-4f990f1c-59d3-47b1-994c-8d9c12bea6b6 req-a1d05ab1-7b4b-4755-8893-a0ebddc18e79 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-deleted-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:13:17 user nova-compute[75409]: INFO nova.compute.manager [req-4f990f1c-59d3-47b1-994c-8d9c12bea6b6 req-a1d05ab1-7b4b-4755-8893-a0ebddc18e79 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Neutron deleted interface ec4c1738-4831-429b-aef9-db1ae28302d5; detaching it from the instance and deleting it from the info cache
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.network.neutron [req-4f990f1c-59d3-47b1-994c-8d9c12bea6b6 req-a1d05ab1-7b4b-4755-8893-a0ebddc18e79 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:13:17 user nova-compute[75409]: DEBUG nova.compute.manager [req-4f990f1c-59d3-47b1-994c-8d9c12bea6b6 req-a1d05ab1-7b4b-4755-8893-a0ebddc18e79 service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Detach interface failed, port_id=ec4c1738-4831-429b-aef9-db1ae28302d5, reason: Instance d420ec12-97e3-4b89-ac7d-f29965223e73 could not be found. {{(pid=75409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] Acquiring lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG nova.compute.manager [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] No waiting events found dispatching network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:13:18 user nova-compute[75409]: WARNING nova.compute.manager [req-f46eadba-2882-44ce-8162-231038ffadf2 req-b92a5d44-7851-46ed-9dd0-075b881748ba service nova] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Received unexpected event network-vif-plugged-ec4c1738-4831-429b-aef9-db1ae28302d5 for instance with vm_state active and task_state deleting.
Nov 15 22:13:18 user nova-compute[75409]: INFO nova.compute.manager [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: d420ec12-97e3-4b89-ac7d-f29965223e73] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:13:18 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:18 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Deleted allocations for instance d420ec12-97e3-4b89-ac7d-f29965223e73
Nov 15 22:13:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9ea6c9ba-8eea-499f-a6e3-c831a3f4b6fc tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "d420ec12-97e3-4b89-ac7d-f29965223e73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:13:20 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:13:20 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.883392333984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:13:20 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:13:21 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:13:21 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:13:21 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:13:21 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:13:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:13:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:13:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:13:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:13:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:13:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:13:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:13:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:13:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:07 user nova-compute[75409]: INFO nova.compute.manager [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Terminating instance
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.compute.manager [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-unplugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] No waiting events found dispatching network-vif-unplugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.compute.manager [req-162ddeef-058c-4e4a-8431-16ae90147c69 req-33d6a04b-434d-48ba-b076-b955df414080 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-unplugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:14:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Instance destroyed successfully.
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.objects.instance [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lazy-loading 'resources' on Instance uuid f62194e4-7efa-44b1-a55a-8ac3cbd34c70 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T21:54:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-16262297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-16262297',id=44,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T21:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e2f290e33ee4356a9b192bf4247a641',ramdisk_id='',reservation_id='r-vqvzbgex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283656267',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T21:56:26Z,user_data=None,user_id='acbca9cebb9941eb8206ad4aca81cd96',uuid=f62194e4-7efa-44b1-a55a-8ac3cbd34c70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converting VIF {"id": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "address": "fa:16:3e:08:8a:00", "network": {"id": "6a37b375-f9e8-4348-88d6-0d748f3e3d5e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-72716251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e2f290e33ee4356a9b192bf4247a641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c6951-7b", "ovs_interfaceid": "7e4c6951-7b4c-4324-bc70-895bf73cc2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG os_vif [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e4c6951-7b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4650157b-511c-41eb-8c58-49145a0b817b) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:07 user nova-compute[75409]: INFO os_vif [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:8a:00,bridge_name='br-int',has_traffic_filtering=True,id=7e4c6951-7b4c-4324-bc70-895bf73cc2a6,network=Network(6a37b375-f9e8-4348-88d6-0d748f3e3d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c6951-7b')
Nov 15 22:14:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Deleting instance files /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70_del
Nov 15 22:14:07 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Deletion of /opt/stack/data/nova/instances/f62194e4-7efa-44b1-a55a-8ac3cbd34c70_del complete
Nov 15 22:14:07 user nova-compute[75409]: INFO nova.compute.manager [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 22:14:07 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:14:07 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:14:08 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:14:08 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Took 0.69 seconds to deallocate network for instance.
Nov 15 22:14:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:14:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:14:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:08 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Deleted allocations for instance f62194e4-7efa-44b1-a55a-8ac3cbd34c70
Nov 15 22:14:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-ba72cd88-af7c-4a20-8045-f3d733a3d32a tempest-ServerBootFromVolumeStableRescueTest-283656267 tempest-ServerBootFromVolumeStableRescueTest-283656267-project-member] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:14:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] Acquiring lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] Lock "f62194e4-7efa-44b1-a55a-8ac3cbd34c70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] No waiting events found dispatching network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:14:09 user nova-compute[75409]: WARNING nova.compute.manager [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received unexpected event network-vif-plugged-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 for instance with vm_state deleted and task_state None.
Nov 15 22:14:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-9573dea5-3664-4329-9603-2174fab9fe3c req-ad84a04d-44d7-4266-93b2-27ec7a08cbf2 service nova] [instance: f62194e4-7efa-44b1-a55a-8ac3cbd34c70] Received event network-vif-deleted-7e4c6951-7b4c-4324-bc70-895bf73cc2a6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:14:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:14:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:14:22 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:14:22 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9179MB free_disk=25.008041381835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:14:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:14:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:14:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:14:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:14:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:14:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:14:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:15:08 user nova-compute[75409]: INFO nova.compute.claims [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Claim successful on node user
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:15:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.policy [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb214eb46e434fb0b05424fd484619cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e406cfdff04593b0ef4663b691a608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:15:08 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Creating image(s)
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "/opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "/opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "/opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:08 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.185s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Successfully created port: e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Cannot resize image /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Ensure instance console log exists: /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Successfully updated port: e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-changed-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.compute.manager [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Refreshing instance network info cache due to event network-changed-e6f1eb24-6724-4eba-b4b7-9fc667957112. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Instance network_info: |[{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Refreshing network info cache for port e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Start _get_guest_xml network_info=[{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:15:10 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:15:10 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1050633770',display_name='tempest-ServersNegativeTestJSON-server-1050633770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1050633770',id=50,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-w021s0xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:15:09Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=15e8bb10-320a-4404-8d49-c39c23938aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.objects.instance [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lazy-loading 'pci_devices' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:15:10 user nova-compute[75409]:   <uuid>15e8bb10-320a-4404-8d49-c39c23938aa8</uuid>
Nov 15 22:15:10 user nova-compute[75409]:   <name>instance-00000032</name>
Nov 15 22:15:10 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:15:10 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:15:10 user nova-compute[75409]:   <metadata>
Nov 15 22:15:10 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:15:10 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:name>tempest-ServersNegativeTestJSON-server-1050633770</nova:name>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:15:10</nova:creationTime>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:15:10 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:15:10 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:owner>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:user uuid="bb214eb46e434fb0b05424fd484619cf">tempest-ServersNegativeTestJSON-205611181-project-member</nova:user>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:project uuid="60e406cfdff04593b0ef4663b691a608">tempest-ServersNegativeTestJSON-205611181</nova:project>
Nov 15 22:15:10 user nova-compute[75409]:       </nova:owner>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:15:10 user nova-compute[75409]:       <nova:ports>
Nov 15 22:15:10 user nova-compute[75409]:         <nova:port uuid="e6f1eb24-6724-4eba-b4b7-9fc667957112">
Nov 15 22:15:10 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 22:15:10 user nova-compute[75409]:         </nova:port>
Nov 15 22:15:10 user nova-compute[75409]:       </nova:ports>
Nov 15 22:15:10 user nova-compute[75409]:     </nova:instance>
Nov 15 22:15:10 user nova-compute[75409]:   </metadata>
Nov 15 22:15:10 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:15:10 user nova-compute[75409]:     <system>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="serial">15e8bb10-320a-4404-8d49-c39c23938aa8</entry>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="uuid">15e8bb10-320a-4404-8d49-c39c23938aa8</entry>
Nov 15 22:15:10 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:15:10 user nova-compute[75409]:     </system>
Nov 15 22:15:10 user nova-compute[75409]:   </sysinfo>
Nov 15 22:15:10 user nova-compute[75409]:   <os>
Nov 15 22:15:10 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:15:10 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:15:10 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:15:10 user nova-compute[75409]:   </os>
Nov 15 22:15:10 user nova-compute[75409]:   <features>
Nov 15 22:15:10 user nova-compute[75409]:     <acpi/>
Nov 15 22:15:10 user nova-compute[75409]:     <apic/>
Nov 15 22:15:10 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:15:10 user nova-compute[75409]:   </features>
Nov 15 22:15:10 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:15:10 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:15:10 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:15:10 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:15:10 user nova-compute[75409]:   </clock>
Nov 15 22:15:10 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:15:10 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:15:10 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:15:10 user nova-compute[75409]:   </cpu>
Nov 15 22:15:10 user nova-compute[75409]:   <devices>
Nov 15 22:15:10 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:15:10 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:15:10 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk"/>
Nov 15 22:15:10 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:15:10 user nova-compute[75409]:     </disk>
Nov 15 22:15:10 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:15:10 user nova-compute[75409]:       <mac address="fa:16:3e:d8:92:6c"/>
Nov 15 22:15:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:15:10 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:15:10 user nova-compute[75409]:       <target dev="tape6f1eb24-67"/>
Nov 15 22:15:10 user nova-compute[75409]:     </interface>
Nov 15 22:15:10 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:15:10 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/console.log" append="off"/>
Nov 15 22:15:10 user nova-compute[75409]:     </serial>
Nov 15 22:15:10 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:15:10 user nova-compute[75409]:     <video>
Nov 15 22:15:10 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:15:10 user nova-compute[75409]:     </video>
Nov 15 22:15:10 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:15:10 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:15:10 user nova-compute[75409]:     </rng>
Nov 15 22:15:10 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:15:10 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:15:10 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:15:10 user nova-compute[75409]:     </memballoon>
Nov 15 22:15:10 user nova-compute[75409]:   </devices>
Nov 15 22:15:10 user nova-compute[75409]: </domain>
Nov 15 22:15:10 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1050633770',display_name='tempest-ServersNegativeTestJSON-server-1050633770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1050633770',id=50,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-w021s0xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:15:09Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=15e8bb10-320a-4404-8d49-c39c23938aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG os_vif [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3da110f-80b7-5da0-b980-e4ee8df4ffa2', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6f1eb24-67, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6f1eb24-67, col_values=(('qos', UUID('4d91e11d-3873-4b86-91ad-b9474f562296')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6f1eb24-67, col_values=(('external_ids', {'iface-id': 'e6f1eb24-6724-4eba-b4b7-9fc667957112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:92:6c', 'vm-uuid': '15e8bb10-320a-4404-8d49-c39c23938aa8'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: INFO os_vif [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67')
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] No VIF found with MAC fa:16:3e:d8:92:6c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated VIF entry in instance network info cache for port e6f1eb24-6724-4eba-b4b7-9fc667957112. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG nova.network.neutron [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:15:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-327d93c9-caf2-45cf-a17f-702abe83a088 req-526db64e-6799-40ae-950d-de39271456c0 service nova] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:15:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.compute.manager [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:15:13 user nova-compute[75409]: WARNING nova.compute.manager [req-52aeba90-597e-49cf-86df-5075054ff57b req-486d6bbb-9f4d-4e32-9d8b-9da7b6959882 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state building and task_state spawning.
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:15:13 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Instance spawned successfully.
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:13 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:15:14 user nova-compute[75409]: INFO nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 15 22:15:14 user nova-compute[75409]: DEBUG nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:15:14 user nova-compute[75409]: INFO nova.compute.manager [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Took 5.70 seconds to build instance.
Nov 15 22:15:14 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-99e5fc93-f2dd-44aa-8755-26297d7d6833 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.800s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:15:15 user nova-compute[75409]: WARNING nova.compute.manager [req-c0a24b9f-6d48-4edc-8120-e4b97c61817d req-c53aeb03-ca67-44dd-a5c4-94757ba022ef service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state active and task_state None.
Nov 15 22:15:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:15:22 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:15:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:15:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:15:23 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=24.997928619384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:15:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:15:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:15:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:15:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:21 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:21 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:16:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:16:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:16:23 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.96957778930664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:16:23 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:16:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:16:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:16:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:16:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:16:37 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:16:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:16:59 user nova-compute[75409]: INFO nova.compute.claims [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Claim successful on node user
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:16:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.policy [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb214eb46e434fb0b05424fd484619cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e406cfdff04593b0ef4663b691a608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:16:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Creating image(s)
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "/opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "/opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:16:59 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.197s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Successfully created port: 36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk 1073741824" returned: 0 in 0.059s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Cannot resize image /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Ensure instance console log exists: /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Successfully updated port: 36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquired lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:17:00 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-changed-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.compute.manager [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Refreshing instance network info cache due to event network-changed-36a24c62-5ba4-4bb9-9eb2-178783cc7580. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] Acquiring lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.neutron [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updating instance_info_cache with network_info: [{"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Releasing lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Instance network_info: |[{"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] Acquired lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Refreshing network info cache for port 36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Start _get_guest_xml network_info=[{"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:17:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:17:01 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-924638695',display_name='tempest-ServersNegativeTestJSON-server-924638695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-924638695',id=51,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-dijq1mki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:17:00Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=a6c592de-523c-48e9-bf47-dc5897e7c0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lazy-loading 'pci_devices' on Instance uuid a6c592de-523c-48e9-bf47-dc5897e7c0e6 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:17:01 user nova-compute[75409]:   <uuid>a6c592de-523c-48e9-bf47-dc5897e7c0e6</uuid>
Nov 15 22:17:01 user nova-compute[75409]:   <name>instance-00000033</name>
Nov 15 22:17:01 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:17:01 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:17:01 user nova-compute[75409]:   <metadata>
Nov 15 22:17:01 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:17:01 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:name>tempest-ServersNegativeTestJSON-server-924638695</nova:name>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:17:01</nova:creationTime>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:17:01 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:17:01 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:owner>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:user uuid="bb214eb46e434fb0b05424fd484619cf">tempest-ServersNegativeTestJSON-205611181-project-member</nova:user>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:project uuid="60e406cfdff04593b0ef4663b691a608">tempest-ServersNegativeTestJSON-205611181</nova:project>
Nov 15 22:17:01 user nova-compute[75409]:       </nova:owner>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:17:01 user nova-compute[75409]:       <nova:ports>
Nov 15 22:17:01 user nova-compute[75409]:         <nova:port uuid="36a24c62-5ba4-4bb9-9eb2-178783cc7580">
Nov 15 22:17:01 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 22:17:01 user nova-compute[75409]:         </nova:port>
Nov 15 22:17:01 user nova-compute[75409]:       </nova:ports>
Nov 15 22:17:01 user nova-compute[75409]:     </nova:instance>
Nov 15 22:17:01 user nova-compute[75409]:   </metadata>
Nov 15 22:17:01 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:17:01 user nova-compute[75409]:     <system>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="serial">a6c592de-523c-48e9-bf47-dc5897e7c0e6</entry>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="uuid">a6c592de-523c-48e9-bf47-dc5897e7c0e6</entry>
Nov 15 22:17:01 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:17:01 user nova-compute[75409]:     </system>
Nov 15 22:17:01 user nova-compute[75409]:   </sysinfo>
Nov 15 22:17:01 user nova-compute[75409]:   <os>
Nov 15 22:17:01 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:17:01 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:17:01 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:17:01 user nova-compute[75409]:   </os>
Nov 15 22:17:01 user nova-compute[75409]:   <features>
Nov 15 22:17:01 user nova-compute[75409]:     <acpi/>
Nov 15 22:17:01 user nova-compute[75409]:     <apic/>
Nov 15 22:17:01 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:17:01 user nova-compute[75409]:   </features>
Nov 15 22:17:01 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:17:01 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:17:01 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:17:01 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:17:01 user nova-compute[75409]:   </clock>
Nov 15 22:17:01 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:17:01 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:17:01 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:17:01 user nova-compute[75409]:   </cpu>
Nov 15 22:17:01 user nova-compute[75409]:   <devices>
Nov 15 22:17:01 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:17:01 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:17:01 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk"/>
Nov 15 22:17:01 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:17:01 user nova-compute[75409]:     </disk>
Nov 15 22:17:01 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:17:01 user nova-compute[75409]:       <mac address="fa:16:3e:92:67:ea"/>
Nov 15 22:17:01 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:17:01 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:17:01 user nova-compute[75409]:       <target dev="tap36a24c62-5b"/>
Nov 15 22:17:01 user nova-compute[75409]:     </interface>
Nov 15 22:17:01 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:17:01 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/console.log" append="off"/>
Nov 15 22:17:01 user nova-compute[75409]:     </serial>
Nov 15 22:17:01 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:17:01 user nova-compute[75409]:     <video>
Nov 15 22:17:01 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:17:01 user nova-compute[75409]:     </video>
Nov 15 22:17:01 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:17:01 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:17:01 user nova-compute[75409]:     </rng>
Nov 15 22:17:01 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:17:01 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:17:01 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:17:01 user nova-compute[75409]:     </memballoon>
Nov 15 22:17:01 user nova-compute[75409]:   </devices>
Nov 15 22:17:01 user nova-compute[75409]: </domain>
Nov 15 22:17:01 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-924638695',display_name='tempest-ServersNegativeTestJSON-server-924638695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-924638695',id=51,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-dijq1mki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:17:00Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=a6c592de-523c-48e9-bf47-dc5897e7c0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG os_vif [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fab219e-0067-5c16-bdf3-14bf5c8d5967', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36a24c62-5b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36a24c62-5b, col_values=(('qos', UUID('b50254de-03c5-4f07-81f2-44d21bc6b78e')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36a24c62-5b, col_values=(('external_ids', {'iface-id': '36a24c62-5ba4-4bb9-9eb2-178783cc7580', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:67:ea', 'vm-uuid': 'a6c592de-523c-48e9-bf47-dc5897e7c0e6'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:01 user nova-compute[75409]: INFO os_vif [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b')
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] No VIF found with MAC fa:16:3e:92:67:ea, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updated VIF entry in instance network info cache for port 36a24c62-5ba4-4bb9-9eb2-178783cc7580. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG nova.network.neutron [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updating instance_info_cache with network_info: [{"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:17:01 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-b54b3880-01e6-4749-abf0-9d271ab0e759 req-449f14f0-5070-4fd5-b363-2c5158fd9628 service nova] Releasing lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:02 user nova-compute[75409]: DEBUG nova.compute.manager [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] No waiting events found dispatching network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:17:02 user nova-compute[75409]: WARNING nova.compute.manager [req-9c8f6232-27db-4333-8eb5-82cac6fe5f0b req-37a56e23-2e50-48b8-a683-8e399c1ed2ba service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received unexpected event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 for instance with vm_state building and task_state spawning.
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:17:04 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Instance spawned successfully.
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:17:04 user nova-compute[75409]: INFO nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:17:04 user nova-compute[75409]: INFO nova.compute.manager [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Took 5.66 seconds to build instance.
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:04 user nova-compute[75409]: DEBUG nova.compute.manager [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] No waiting events found dispatching network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:17:04 user nova-compute[75409]: WARNING nova.compute.manager [req-48391083-2a86-456e-958e-ea7b440c30d6 req-64ba5052-09e5-4780-afa4-d1472814b558 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received unexpected event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 for instance with vm_state active and task_state None.
Nov 15 22:17:04 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9d26f0c6-481b-4df6-ae41-1ee0d9c1a3be tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.759s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:23 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:17:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:17:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.94158935546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a6c592de-523c-48e9-bf47-dc5897e7c0e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:17:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:17:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:17:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:17:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:17:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:01 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:11 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:16 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:21 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:23 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:24 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:24 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:18:25 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:18:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:18:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.93960189819336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance a6c592de-523c-48e9-bf47-dc5897e7c0e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:18:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updating instance_info_cache with network_info: [{"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-a6c592de-523c-48e9-bf47-dc5897e7c0e6" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:18:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:18:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:18:36 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:18:46 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:49 user nova-compute[75409]: INFO nova.compute.manager [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Terminating instance
Nov 15 22:18:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-unplugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] No waiting events found dispatching network-vif-unplugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-e224055a-d4d6-41a3-83c3-035e74749e86 req-ec92c347-887e-4695-8645-f035c3385318 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-unplugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Instance destroyed successfully.
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.objects.instance [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lazy-loading 'resources' on Instance uuid a6c592de-523c-48e9-bf47-dc5897e7c0e6 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-924638695',display_name='tempest-ServersNegativeTestJSON-server-924638695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-924638695',id=51,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:17:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-dijq1mki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:17:05Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=a6c592de-523c-48e9-bf47-dc5897e7c0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "address": "fa:16:3e:92:67:ea", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a24c62-5b", "ovs_interfaceid": "36a24c62-5ba4-4bb9-9eb2-178783cc7580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG os_vif [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36a24c62-5b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b50254de-03c5-4f07-81f2-44d21bc6b78e) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:18:50 user nova-compute[75409]: INFO os_vif [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:67:ea,bridge_name='br-int',has_traffic_filtering=True,id=36a24c62-5ba4-4bb9-9eb2-178783cc7580,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a24c62-5b')
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Deleting instance files /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6_del
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Deletion of /opt/stack/data/nova/instances/a6c592de-523c-48e9-bf47-dc5897e7c0e6_del complete
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.compute.manager [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 22:18:50 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Took 0.37 seconds to deallocate network for instance.
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.compute.manager [req-ad895212-7fa1-4469-9bd5-76e47eb92bbf req-6936c0aa-636a-4f14-a304-f73ac818c012 service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-deleted-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:18:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:50 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Deleted allocations for instance a6c592de-523c-48e9-bf47-dc5897e7c0e6
Nov 15 22:18:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-9db3e8b3-e474-4e7c-a83a-7d0c16b689a2 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:18:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] Acquiring lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:18:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:18:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] Lock "a6c592de-523c-48e9-bf47-dc5897e7c0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:18:51 user nova-compute[75409]: DEBUG nova.compute.manager [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] No waiting events found dispatching network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:18:51 user nova-compute[75409]: WARNING nova.compute.manager [req-273a8e55-b89d-4788-8a78-423a65419b9b req-f962541e-657e-46e6-8988-8d90b77b8fae service nova] [instance: a6c592de-523c-48e9-bf47-dc5897e7c0e6] Received unexpected event network-vif-plugged-36a24c62-5ba4-4bb9-9eb2-178783cc7580 for instance with vm_state deleted and task_state None.
Nov 15 22:18:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:19:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:19:26 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:19:26 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9043MB free_disk=24.96680450439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:19:26 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:19:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:19:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:19:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:19:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:20:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:20:27 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:20:27 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=24.966224670410156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:20:27 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:20:28 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:20:28 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:20:28 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:20:28 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:20:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:20:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:20:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:20:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:20:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:20:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:21:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:21:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:26 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:28 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:21:29 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:21:29 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:21:29 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9053MB free_disk=24.965576171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:21:29 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:21:30 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:21:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:21:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:21:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:21:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:21:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:21:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:22:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:02 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:02 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:22:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:22:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:22:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:22:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:22:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:28 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:29 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:22:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:22:31 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:22:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:22:32 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=24.965011596679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:22:32 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:22:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:22:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:22:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:22:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:22:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:22:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:23:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:23:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:29 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:30 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:23:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [{"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-15e8bb10-320a-4404-8d49-c39c23938aa8" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:23:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:23:33 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:23:33 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:23:33 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=24.964393615722656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 15e8bb10-320a-4404-8d49-c39c23938aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:23:33 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:23:34 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:23:34 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:23:34 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:23:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:23:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:23:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:51 user nova-compute[75409]: INFO nova.compute.manager [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Terminating instance
Nov 15 22:23:51 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Instance destroyed successfully.
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lazy-loading 'resources' on Instance uuid 15e8bb10-320a-4404-8d49-c39c23938aa8 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1050633770',display_name='tempest-ServersNegativeTestJSON-server-1050633770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1050633770',id=50,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e406cfdff04593b0ef4663b691a608',ramdisk_id='',reservation_id='r-w021s0xo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-205611181',owner_user_name='tempest-ServersNegativeTestJSON-205611181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:15:14Z,user_data=None,user_id='bb214eb46e434fb0b05424fd484619cf',uuid=15e8bb10-320a-4404-8d49-c39c23938aa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converting VIF {"id": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "address": "fa:16:3e:d8:92:6c", "network": {"id": "928342a0-c613-4248-9233-2a0fb4707ebf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697062314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e406cfdff04593b0ef4663b691a608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f1eb24-67", "ovs_interfaceid": "e6f1eb24-6724-4eba-b4b7-9fc667957112", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG os_vif [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6f1eb24-67, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d91e11d-3873-4b86-91ad-b9474f562296) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-8d0ba6ae-5912-4b21-95b8-74462522e2fc req-3aaadc15-7bad-4c43-8d89-c5ef2923caa9 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:23:52 user nova-compute[75409]: INFO os_vif [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=e6f1eb24-6724-4eba-b4b7-9fc667957112,network=Network(928342a0-c613-4248-9233-2a0fb4707ebf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f1eb24-67')
Nov 15 22:23:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Deleting instance files /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8_del
Nov 15 22:23:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Deletion of /opt/stack/data/nova/instances/15e8bb10-320a-4404-8d49-c39c23938aa8_del complete
Nov 15 22:23:52 user nova-compute[75409]: INFO nova.compute.manager [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:23:52 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Took 0.56 seconds to deallocate network for instance.
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-802f27b8-653c-4625-9bef-c1d07fe9c972 req-e204836d-a0db-4201-ba3d-a23df5175acc service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-deleted-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:53 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:23:53 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:23:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:53 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Deleted allocations for instance 15e8bb10-320a-4404-8d49-c39c23938aa8
Nov 15 22:23:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7cf8c516-065c-4604-8e2a-c6b662662924 tempest-ServersNegativeTestJSON-205611181 tempest-ServersNegativeTestJSON-205611181-project-member] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:54 user nova-compute[75409]: WARNING nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state deleted and task_state None.
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:54 user nova-compute[75409]: WARNING nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state deleted and task_state None.
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:54 user nova-compute[75409]: WARNING nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state deleted and task_state None.
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:54 user nova-compute[75409]: WARNING nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-unplugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state deleted and task_state None.
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Acquiring lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] Lock "15e8bb10-320a-4404-8d49-c39c23938aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:23:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] No waiting events found dispatching network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:23:54 user nova-compute[75409]: WARNING nova.compute.manager [req-c0b5c62e-098c-4038-a244-6ad35b147a50 req-d201e1db-7bf8-4091-a8d5-291ef7f3b6b3 service nova] [instance: 15e8bb10-320a-4404-8d49-c39c23938aa8] Received unexpected event network-vif-plugged-e6f1eb24-6724-4eba-b4b7-9fc667957112 for instance with vm_state deleted and task_state None.
Nov 15 22:23:57 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:02 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:12 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:24:17 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:22 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:27 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:30 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:24:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:24:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:24:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:24:32 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:24:35 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:24:35 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=24.991363525390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:24:35 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:37 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:24:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:47 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:24:52 user nova-compute[75409]: INFO nova.compute.claims [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Claim successful on node user
Nov 15 22:24:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:24:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.policy [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685022485aa84b019bec885c1dc234a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3925f5a7cf470481415ac831c2ff60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:24:52 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Creating image(s)
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "/opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "/opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.175s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:24:52 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk 1073741824" returned: 0 in 0.052s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.176s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Successfully created port: db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Cannot resize image /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Successfully updated port: db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquired lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-changed-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.compute.manager [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Refreshing instance network info cache due to event network-changed-db3211c9-7b7f-4693-9d1d-628227d428f6. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] Acquiring lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:24:53 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.neutron [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updating instance_info_cache with network_info: [{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Releasing lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Instance network_info: |[{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] Acquired lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Refreshing network info cache for port db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Start _get_guest_xml network_info=[{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:24:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:24:54 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321969850',display_name='tempest-VolumesNegativeTest-instance-1321969850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321969850',id=52,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b3925f5a7cf470481415ac831c2ff60',ramdisk_id='',reservation_id='r-vzxohtlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-744476615',owner_user_name='tempest-VolumesNegativeTest-744476615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:24:53Z,user_data=None,user_id='685022485aa84b019bec885c1dc234a8',uuid=3ff265d9-9af1-4816-b824-cb97b16cf7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converting VIF {"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff265d9-9af1-4816-b824-cb97b16cf7b5 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:24:54 user nova-compute[75409]:   <uuid>3ff265d9-9af1-4816-b824-cb97b16cf7b5</uuid>
Nov 15 22:24:54 user nova-compute[75409]:   <name>instance-00000034</name>
Nov 15 22:24:54 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:24:54 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:24:54 user nova-compute[75409]:   <metadata>
Nov 15 22:24:54 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:24:54 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:name>tempest-VolumesNegativeTest-instance-1321969850</nova:name>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:24:54</nova:creationTime>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:24:54 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:24:54 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:owner>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:user uuid="685022485aa84b019bec885c1dc234a8">tempest-VolumesNegativeTest-744476615-project-member</nova:user>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:project uuid="7b3925f5a7cf470481415ac831c2ff60">tempest-VolumesNegativeTest-744476615</nova:project>
Nov 15 22:24:54 user nova-compute[75409]:       </nova:owner>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:24:54 user nova-compute[75409]:       <nova:ports>
Nov 15 22:24:54 user nova-compute[75409]:         <nova:port uuid="db3211c9-7b7f-4693-9d1d-628227d428f6">
Nov 15 22:24:54 user nova-compute[75409]:           <nova:ip type="fixed" address="192.168.233.195" ipVersion="4"/>
Nov 15 22:24:54 user nova-compute[75409]:         </nova:port>
Nov 15 22:24:54 user nova-compute[75409]:       </nova:ports>
Nov 15 22:24:54 user nova-compute[75409]:     </nova:instance>
Nov 15 22:24:54 user nova-compute[75409]:   </metadata>
Nov 15 22:24:54 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:24:54 user nova-compute[75409]:     <system>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="serial">3ff265d9-9af1-4816-b824-cb97b16cf7b5</entry>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="uuid">3ff265d9-9af1-4816-b824-cb97b16cf7b5</entry>
Nov 15 22:24:54 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:24:54 user nova-compute[75409]:     </system>
Nov 15 22:24:54 user nova-compute[75409]:   </sysinfo>
Nov 15 22:24:54 user nova-compute[75409]:   <os>
Nov 15 22:24:54 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:24:54 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:24:54 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:24:54 user nova-compute[75409]:   </os>
Nov 15 22:24:54 user nova-compute[75409]:   <features>
Nov 15 22:24:54 user nova-compute[75409]:     <acpi/>
Nov 15 22:24:54 user nova-compute[75409]:     <apic/>
Nov 15 22:24:54 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:24:54 user nova-compute[75409]:   </features>
Nov 15 22:24:54 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:24:54 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:24:54 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:24:54 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:24:54 user nova-compute[75409]:   </clock>
Nov 15 22:24:54 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:24:54 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:24:54 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:24:54 user nova-compute[75409]:   </cpu>
Nov 15 22:24:54 user nova-compute[75409]:   <devices>
Nov 15 22:24:54 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:24:54 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:24:54 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk"/>
Nov 15 22:24:54 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:24:54 user nova-compute[75409]:     </disk>
Nov 15 22:24:54 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:24:54 user nova-compute[75409]:       <mac address="fa:16:3e:80:1c:0c"/>
Nov 15 22:24:54 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:24:54 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:24:54 user nova-compute[75409]:       <target dev="tapdb3211c9-7b"/>
Nov 15 22:24:54 user nova-compute[75409]:     </interface>
Nov 15 22:24:54 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:24:54 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/console.log" append="off"/>
Nov 15 22:24:54 user nova-compute[75409]:     </serial>
Nov 15 22:24:54 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:24:54 user nova-compute[75409]:     <video>
Nov 15 22:24:54 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:24:54 user nova-compute[75409]:     </video>
Nov 15 22:24:54 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:24:54 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:24:54 user nova-compute[75409]:     </rng>
Nov 15 22:24:54 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:24:54 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:24:54 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:24:54 user nova-compute[75409]:     </memballoon>
Nov 15 22:24:54 user nova-compute[75409]:   </devices>
Nov 15 22:24:54 user nova-compute[75409]: </domain>
Nov 15 22:24:54 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321969850',display_name='tempest-VolumesNegativeTest-instance-1321969850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321969850',id=52,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b3925f5a7cf470481415ac831c2ff60',ramdisk_id='',reservation_id='r-vzxohtlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-744476615',owner_user_name='tempest-VolumesNegativeTest-744476615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:24:53Z,user_data=None,user_id='685022485aa84b019bec885c1dc234a8',uuid=3ff265d9-9af1-4816-b824-cb97b16cf7b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converting VIF {"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG os_vif [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9389ce6-6dd9-582d-8be6-10c2152a3b52', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb3211c9-7b, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb3211c9-7b, col_values=(('qos', UUID('5d4e4264-8aa9-45e3-a1e1-9d82528caf2f')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb3211c9-7b, col_values=(('external_ids', {'iface-id': 'db3211c9-7b7f-4693-9d1d-628227d428f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:1c:0c', 'vm-uuid': '3ff265d9-9af1-4816-b824-cb97b16cf7b5'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:54 user nova-compute[75409]: INFO os_vif [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b')
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] No VIF found with MAC fa:16:3e:80:1c:0c, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updated VIF entry in instance network info cache for port db3211c9-7b7f-4693-9d1d-628227d428f6. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG nova.network.neutron [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updating instance_info_cache with network_info: [{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:24:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-362759e2-7c2e-4719-9c1c-8c01307aa5f8 req-a7b1bb42-6ea7-41ff-ae5a-84d782dac620 service nova] Releasing lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:55 user nova-compute[75409]: DEBUG nova.compute.manager [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] No waiting events found dispatching network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:24:55 user nova-compute[75409]: WARNING nova.compute.manager [req-03e8d471-9b4d-4e90-ba48-bffaf1a4a26e req-e8ff4493-d67c-48c6-a147-79dcc4b4d87c service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received unexpected event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 for instance with vm_state building and task_state spawning.
Nov 15 22:24:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:56 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:24:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Instance spawned successfully.
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:24:57 user nova-compute[75409]: INFO nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 15 22:24:57 user nova-compute[75409]: DEBUG nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:24:57 user nova-compute[75409]: INFO nova.compute.manager [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Took 5.68 seconds to build instance.
Nov 15 22:24:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7e3eb248-e242-4566-af73-ebb446742a64 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.778s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:24:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:24:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:24:58 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:24:58 user nova-compute[75409]: DEBUG nova.compute.manager [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] No waiting events found dispatching network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:24:58 user nova-compute[75409]: WARNING nova.compute.manager [req-129a3a02-87d2-440c-81fe-ef32268edbdc req-8b75251d-498d-4f02-80d9-e058ca184986 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received unexpected event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 for instance with vm_state active and task_state None.
Nov 15 22:24:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:31 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:31 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:25:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 3ff265d9-9af1-4816-b824-cb97b16cf7b5 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updating instance_info_cache with network_info: [{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:25:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:25:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:25:36 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.961360931396484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 3ff265d9-9af1-4816-b824-cb97b16cf7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:25:36 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:25:37 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:25:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:25:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:25:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:25:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:25:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:25:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:25:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:32 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:32 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:26:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 3ff265d9-9af1-4816-b824-cb97b16cf7b5 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updating instance_info_cache with network_info: [{"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-3ff265d9-9af1-4816-b824-cb97b16cf7b5" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:26:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:26:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:26:38 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:26:38 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:26:38 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.96076202392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 3ff265d9-9af1-4816-b824-cb97b16cf7b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:42 user nova-compute[75409]: INFO nova.compute.manager [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Terminating instance
Nov 15 22:26:42 user nova-compute[75409]: DEBUG nova.compute.manager [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-unplugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] No waiting events found dispatching network-vif-unplugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG nova.compute.manager [req-4e047fdc-a1d0-4317-bc77-c1b62158370a req-85b21e5f-649d-437f-af25-58953b11fa04 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-unplugged-db3211c9-7b7f-4693-9d1d-628227d428f6 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:26:42 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Instance destroyed successfully.
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.objects.instance [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lazy-loading 'resources' on Instance uuid 3ff265d9-9af1-4816-b824-cb97b16cf7b5 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321969850',display_name='tempest-VolumesNegativeTest-instance-1321969850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321969850',id=52,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:24:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b3925f5a7cf470481415ac831c2ff60',ramdisk_id='',reservation_id='r-vzxohtlr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-744476615',owner_user_name='tempest-VolumesNegativeTest-744476615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:24:58Z,user_data=None,user_id='685022485aa84b019bec885c1dc234a8',uuid=3ff265d9-9af1-4816-b824-cb97b16cf7b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converting VIF {"id": "db3211c9-7b7f-4693-9d1d-628227d428f6", "address": "fa:16:3e:80:1c:0c", "network": {"id": "1428e1c3-ede8-4fe8-8817-8b14ef5f2105", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dc047b0539b9493a8ed86f32d018ac20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3211c9-7b", "ovs_interfaceid": "db3211c9-7b7f-4693-9d1d-628227d428f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG os_vif [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb3211c9-7b, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d4e4264-8aa9-45e3-a1e1-9d82528caf2f) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:26:43 user nova-compute[75409]: INFO os_vif [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:1c:0c,bridge_name='br-int',has_traffic_filtering=True,id=db3211c9-7b7f-4693-9d1d-628227d428f6,network=Network(1428e1c3-ede8-4fe8-8817-8b14ef5f2105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3211c9-7b')
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Deleting instance files /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5_del
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Deletion of /opt/stack/data/nova/instances/3ff265d9-9af1-4816-b824-cb97b16cf7b5_del complete
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.compute.manager [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Took 0.37 seconds to deallocate network for instance.
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:26:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:43 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Deleted allocations for instance 3ff265d9-9af1-4816-b824-cb97b16cf7b5
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-356d4e40-ca68-481c-9df6-fae1a51cccb9 tempest-VolumesNegativeTest-744476615 tempest-VolumesNegativeTest-744476615-project-member] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] Acquiring lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] Lock "3ff265d9-9af1-4816-b824-cb97b16cf7b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] No waiting events found dispatching network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:26:44 user nova-compute[75409]: WARNING nova.compute.manager [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received unexpected event network-vif-plugged-db3211c9-7b7f-4693-9d1d-628227d428f6 for instance with vm_state deleted and task_state None.
Nov 15 22:26:44 user nova-compute[75409]: DEBUG nova.compute.manager [req-a20d2c55-fd3b-4ff8-8474-ae582ff427ec req-2aaec30e-750d-451b-acbb-04ca24b97704 service nova] [instance: 3ff265d9-9af1-4816-b824-cb97b16cf7b5] Received event network-vif-deleted-db3211c9-7b7f-4693-9d1d-628227d428f6 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:26:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:26:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:27:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:27:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:27:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:27:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:27:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:27:39 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=24.987552642822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:27:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:27:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:27:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:27:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:53 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:27:58 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:08 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:13 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:18 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:23 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:28 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:31 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:33 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:28:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:28:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:28:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:28:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:38 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:28:41 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=24.973812103271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:28:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:43 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:28:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Starting instance... {{(pid=75409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 22:28:47 user nova-compute[75409]: INFO nova.compute.claims [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Claim successful on node user
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Start building networks asynchronously for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Allocating IP information in the background. {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] allocate_for_instance() {{(pid=75409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 22:28:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Start building block device mappings for instance. {{(pid=75409) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Start spawning the instance on the hypervisor. {{(pid=75409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Creating instance directory {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 22:28:47 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Creating image(s)
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "/opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "/opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "/opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG nova.policy [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaca9dab6c4241f1b1a564e2d265ae26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4f7e634d204b1cb8ee7c5db8dd094e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75409) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.193s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "59fd04301ac14f21be580f6b784d89f0f955d573" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.186s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk 1073741824 {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573,backing_fmt=raw /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk 1073741824" returned: 0 in 0.092s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "59fd04301ac14f21be580f6b784d89f0f955d573" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59fd04301ac14f21be580f6b784d89f0f955d573 --force-share --output=json" returned: 0 in 0.189s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk. size=1073741824 {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG nova.virt.disk.api [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Cannot resize image /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk to a smaller size. {{(pid=75409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Created local disks {{(pid=75409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Ensure instance console log exists: /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/console.log {{(pid=75409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:48 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Successfully created port: b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Successfully updated port: b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Building network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-changed-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Refreshing instance network info cache due to event network-changed-b86c127f-b2bc-49ec-bd2f-19219c9bac44. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Instance cache missing network info. {{(pid=75409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.neutron [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Instance network_info: |[{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.neutron [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Refreshing network info cache for port b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Start _get_guest_xml network_info=[{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '76e2224a-f851-4f51-8b88-3264d76e2cea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 22:28:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:28:49 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CPU controller missing on host. {{(pid=75409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.host [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CPU controller found on host. {{(pid=75409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T21:20:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T21:20:57Z,direct_url=<?>,disk_format='qcow2',id=76e2224a-f851-4f51-8b88-3264d76e2cea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dc047b0539b9493a8ed86f32d018ac20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T21:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flavor limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Image limits 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flavor pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Image pref 0:0:0 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Got 1 possible topologies {{(pid=75409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.hardware [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2054424469',display_name='tempest-SnapshotDataIntegrityTests-server-2054424469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2054424469',id=53,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFtPMM41TKX+t7je0A3SieGK2CiogNXtZnkzG+aSMVTExdXcpSi3022Uvng8S3T/5kWKVD1SW+UXyjV8PnCboN3VlN402jPPyy9djktATZ36PDm/zHFGgRMEq1ioNud6w==',key_name='tempest-keypair-1467300331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4f7e634d204b1cb8ee7c5db8dd094e',ramdisk_id='',reservation_id='r-8r306at8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-732686207',owner_user_name='tempest-SnapshotDataIntegrityTests-732686207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaca9dab6c4241f1b1a564e2d265ae26',uuid=40765211-0858-4249-8dfe-fafe530ae799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converting VIF {"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'pci_devices' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] End _get_guest_xml xml=<domain type="kvm">
Nov 15 22:28:49 user nova-compute[75409]:   <uuid>40765211-0858-4249-8dfe-fafe530ae799</uuid>
Nov 15 22:28:49 user nova-compute[75409]:   <name>instance-00000035</name>
Nov 15 22:28:49 user nova-compute[75409]:   <memory>524288</memory>
Nov 15 22:28:49 user nova-compute[75409]:   <vcpu>1</vcpu>
Nov 15 22:28:49 user nova-compute[75409]:   <metadata>
Nov 15 22:28:49 user nova-compute[75409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 22:28:49 user nova-compute[75409]:       <nova:package version="0.0.0"/>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2054424469</nova:name>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:creationTime>2023-11-15 22:28:49</nova:creationTime>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:flavor name="m1.tiny">
Nov 15 22:28:49 user nova-compute[75409]:         <nova:memory>512</nova:memory>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:disk>1</nova:disk>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:swap>0</nova:swap>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:vcpus>1</nova:vcpus>
Nov 15 22:28:49 user nova-compute[75409]:       </nova:flavor>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:owner>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:user uuid="aaca9dab6c4241f1b1a564e2d265ae26">tempest-SnapshotDataIntegrityTests-732686207-project-member</nova:user>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:project uuid="7c4f7e634d204b1cb8ee7c5db8dd094e">tempest-SnapshotDataIntegrityTests-732686207</nova:project>
Nov 15 22:28:49 user nova-compute[75409]:       </nova:owner>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:root type="image" uuid="76e2224a-f851-4f51-8b88-3264d76e2cea"/>
Nov 15 22:28:49 user nova-compute[75409]:       <nova:ports>
Nov 15 22:28:49 user nova-compute[75409]:         <nova:port uuid="b86c127f-b2bc-49ec-bd2f-19219c9bac44">
Nov 15 22:28:49 user nova-compute[75409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 22:28:49 user nova-compute[75409]:         </nova:port>
Nov 15 22:28:49 user nova-compute[75409]:       </nova:ports>
Nov 15 22:28:49 user nova-compute[75409]:     </nova:instance>
Nov 15 22:28:49 user nova-compute[75409]:   </metadata>
Nov 15 22:28:49 user nova-compute[75409]:   <sysinfo type="smbios">
Nov 15 22:28:49 user nova-compute[75409]:     <system>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="product">OpenStack Nova</entry>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="version">0.0.0</entry>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="serial">40765211-0858-4249-8dfe-fafe530ae799</entry>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="uuid">40765211-0858-4249-8dfe-fafe530ae799</entry>
Nov 15 22:28:49 user nova-compute[75409]:       <entry name="family">Virtual Machine</entry>
Nov 15 22:28:49 user nova-compute[75409]:     </system>
Nov 15 22:28:49 user nova-compute[75409]:   </sysinfo>
Nov 15 22:28:49 user nova-compute[75409]:   <os>
Nov 15 22:28:49 user nova-compute[75409]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 22:28:49 user nova-compute[75409]:     <boot dev="hd"/>
Nov 15 22:28:49 user nova-compute[75409]:     <smbios mode="sysinfo"/>
Nov 15 22:28:49 user nova-compute[75409]:   </os>
Nov 15 22:28:49 user nova-compute[75409]:   <features>
Nov 15 22:28:49 user nova-compute[75409]:     <acpi/>
Nov 15 22:28:49 user nova-compute[75409]:     <apic/>
Nov 15 22:28:49 user nova-compute[75409]:     <vmcoreinfo/>
Nov 15 22:28:49 user nova-compute[75409]:   </features>
Nov 15 22:28:49 user nova-compute[75409]:   <clock offset="utc">
Nov 15 22:28:49 user nova-compute[75409]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 22:28:49 user nova-compute[75409]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 22:28:49 user nova-compute[75409]:     <timer name="hpet" present="no"/>
Nov 15 22:28:49 user nova-compute[75409]:   </clock>
Nov 15 22:28:49 user nova-compute[75409]:   <cpu mode="custom" match="exact">
Nov 15 22:28:49 user nova-compute[75409]:     <model>Nehalem</model>
Nov 15 22:28:49 user nova-compute[75409]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 22:28:49 user nova-compute[75409]:   </cpu>
Nov 15 22:28:49 user nova-compute[75409]:   <devices>
Nov 15 22:28:49 user nova-compute[75409]:     <disk type="file" device="disk">
Nov 15 22:28:49 user nova-compute[75409]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 22:28:49 user nova-compute[75409]:       <source file="/opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk"/>
Nov 15 22:28:49 user nova-compute[75409]:       <target dev="vda" bus="virtio"/>
Nov 15 22:28:49 user nova-compute[75409]:     </disk>
Nov 15 22:28:49 user nova-compute[75409]:     <interface type="ethernet">
Nov 15 22:28:49 user nova-compute[75409]:       <mac address="fa:16:3e:73:88:16"/>
Nov 15 22:28:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:28:49 user nova-compute[75409]:       <mtu size="1442"/>
Nov 15 22:28:49 user nova-compute[75409]:       <target dev="tapb86c127f-b2"/>
Nov 15 22:28:49 user nova-compute[75409]:     </interface>
Nov 15 22:28:49 user nova-compute[75409]:     <serial type="pty">
Nov 15 22:28:49 user nova-compute[75409]:       <log file="/opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/console.log" append="off"/>
Nov 15 22:28:49 user nova-compute[75409]:     </serial>
Nov 15 22:28:49 user nova-compute[75409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 22:28:49 user nova-compute[75409]:     <video>
Nov 15 22:28:49 user nova-compute[75409]:       <model type="virtio"/>
Nov 15 22:28:49 user nova-compute[75409]:     </video>
Nov 15 22:28:49 user nova-compute[75409]:     <rng model="virtio">
Nov 15 22:28:49 user nova-compute[75409]:       <backend model="random">/dev/urandom</backend>
Nov 15 22:28:49 user nova-compute[75409]:     </rng>
Nov 15 22:28:49 user nova-compute[75409]:     <controller type="usb" index="0" model="none"/>
Nov 15 22:28:49 user nova-compute[75409]:     <memballoon model="virtio">
Nov 15 22:28:49 user nova-compute[75409]:       <stats period="10"/>
Nov 15 22:28:49 user nova-compute[75409]:     </memballoon>
Nov 15 22:28:49 user nova-compute[75409]:   </devices>
Nov 15 22:28:49 user nova-compute[75409]: </domain>
Nov 15 22:28:49 user nova-compute[75409]:  {{(pid=75409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2054424469',display_name='tempest-SnapshotDataIntegrityTests-server-2054424469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2054424469',id=53,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFtPMM41TKX+t7je0A3SieGK2CiogNXtZnkzG+aSMVTExdXcpSi3022Uvng8S3T/5kWKVD1SW+UXyjV8PnCboN3VlN402jPPyy9djktATZ36PDm/zHFGgRMEq1ioNud6w==',key_name='tempest-keypair-1467300331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4f7e634d204b1cb8ee7c5db8dd094e',ramdisk_id='',reservation_id='r-8r306at8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-732686207',owner_user_name='tempest-SnapshotDataIntegrityTests-732686207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T22:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaca9dab6c4241f1b1a564e2d265ae26',uuid=40765211-0858-4249-8dfe-fafe530ae799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converting VIF {"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG os_vif [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2') {{(pid=75409) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba845411-7091-5f4a-b84e-b1f2d8a46cfa', '_type': 'linux-noop'}}, row=False) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb86c127f-b2, may_exist=True, interface_attrs={}) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb86c127f-b2, col_values=(('qos', UUID('fdd6d960-9145-460d-b852-3b774d9d7835')),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb86c127f-b2, col_values=(('external_ids', {'iface-id': 'b86c127f-b2bc-49ec-bd2f-19219c9bac44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:88:16', 'vm-uuid': '40765211-0858-4249-8dfe-fafe530ae799'}),), if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:49 user nova-compute[75409]: INFO os_vif [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2')
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:28:49 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No VIF found with MAC fa:16:3e:73:88:16, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:28:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated VIF entry in instance network info cache for port b86c127f-b2bc-49ec-bd2f-19219c9bac44. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:28:50 user nova-compute[75409]: DEBUG nova.network.neutron [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:28:50 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-0007edf8-0a65-4cd9-81d1-86fe4343ebc8 req-41dafb6d-1909-46d3-8d97-ed86726e5996 service nova] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:28:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:51 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:52 user nova-compute[75409]: DEBUG nova.compute.manager [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] No waiting events found dispatching network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:28:52 user nova-compute[75409]: WARNING nova.compute.manager [req-201c6b9d-2f0c-4a1b-9bf6-0446981df9d1 req-2ab92d10-ceb0-44a6-b540-aa4d8eb571f4 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received unexpected event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 for instance with vm_state building and task_state spawning.
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Instance event wait completed in 0 seconds for  {{(pid=75409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Guest created on hypervisor {{(pid=75409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 22:28:53 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Instance spawned successfully.
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_cdrom_bus of ide {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_disk_bus of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_input_bus of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_pointer_model of None {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_video_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Found default for hw_vif_model of virtio {{(pid=75409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 22:28:53 user nova-compute[75409]: INFO nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 15 22:28:53 user nova-compute[75409]: DEBUG nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Checking state {{(pid=75409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 22:28:53 user nova-compute[75409]: INFO nova.compute.manager [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Took 6.96 seconds to build instance.
Nov 15 22:28:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-110d92ec-f0e4-489d-a5df-dd103de74ef3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.063s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:28:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:28:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:28:54 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:28:54 user nova-compute[75409]: DEBUG nova.compute.manager [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] No waiting events found dispatching network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:28:54 user nova-compute[75409]: WARNING nova.compute.manager [req-80538edc-b31f-4382-9515-51b4609bdfa3 req-92f9baa3-9176-46ab-baab-3fc5a1bcf202 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received unexpected event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 for instance with vm_state active and task_state None.
Nov 15 22:28:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:28:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:07 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:29:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:29:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:29:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:29:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:29:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.933853149414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:29:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:29:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:29:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:29:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:29:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:30:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:35 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:35 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-changed-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG nova.compute.manager [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Refreshing instance network info cache due to event network-changed-b86c127f-b2bc-49ec-bd2f-19219c9bac44. {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Refreshing network info cache for port b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated VIF entry in instance network info cache for port b86c127f-b2bc-49ec-bd2f-19219c9bac44. {{(pid=75409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG nova.network.neutron [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:30:37 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-c2353426-a543-4ce6-87b4-d027622d341d req-35b31f77-6fa9-4cf8-bed3-be98bf586a2c service nova] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:30:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:30:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:30:40 user nova-compute[75409]: INFO nova.compute.manager [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attaching volume 9833e68b-e80b-4a04-8413-0ab85b5560ba to /dev/vdb
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.utils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ea38e-d16a-46c8-bd99-fba006e56a52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b3c742-b3de-4bd2-8ad8-2e927a9ce5e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9889338a-0009-4ebb-8aef-4f75db84aa98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e41539-bfc6-4009-ab36-b10005a3cad9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:30:40 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 22:30:40 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1614e-3be8-4b68-b0f9-d63c4d65b61f]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG os_brick.utils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating existing volume attachment record: 2acf7c15-8f4e-472d-802e-044cdc84a050 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 22:30:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:30:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:30:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.933074951171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:30:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:30:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:30:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:30:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:30:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EagrOcev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:30:44 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:30:44 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:30:44 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209f662-cfef-4506-8118-8ed3bbc8a511]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 22:30:44 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a513d-535a-4d53-b11e-9ca885aa3714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba] added
Nov 15 22:30:44 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a31322-fb5d-4b26-92b7-a96d0ffcc8e3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227b900-992d-495c-9a20-b94676642a6d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EagrOcev {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EagrOcev" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8cb922-6aba-40d4-a881-6b9b4110a47a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EagrOcev'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547c1f0-83e7-43dd-a486-ca9f7111407d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:44 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619b1a4-9447-4546-a4c7-a76f48e631f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:30:45 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:30:45 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:30:45 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 22:30:45 user nova-compute[75409]: 
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c430b47-468e-4b46-8c73-02012f4f6e47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260]
Nov 15 22:30:45 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260] successful.
Nov 15 22:30:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba09de3-c127-4ba7-b9cc-ed62b0a52829]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[681452d4-9894-4c51-a006-8bad31c84a59]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)
Nov 15 22:30:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)
Nov 15 22:30:45 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdeff21-1085-4a6e-8d42-556fc4912a6d]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:30:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EagrOcev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26264323236306530', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323236306530', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.objects.instance [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 22:30:46 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:30:46 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:30:46 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:30:46 user nova-compute[75409]:   <serial>9833e68b-e80b-4a04-8413-0ab85b5560ba</serial>
Nov 15 22:30:46 user nova-compute[75409]: </disk>
Nov 15 22:30:46 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No VIF found with MAC fa:16:3e:73:88:16, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:30:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-a25b5658-ba8d-4e46-8d3f-327140984da5 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.691s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:30:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:30:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:30:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:30:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:30:57 user nova-compute[75409]: INFO nova.compute.manager [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Detaching volume 9833e68b-e80b-4a04-8413-0ab85b5560ba
Nov 15 22:30:57 user nova-compute[75409]: INFO nova.virt.block_device [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attempting to driver detach volume 9833e68b-e80b-4a04-8413-0ab85b5560ba from mountpoint /dev/vdb
Nov 15 22:30:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Attempting to detach device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 22:30:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:30:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:30:57 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:30:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:30:57 user nova-compute[75409]:   <serial>9833e68b-e80b-4a04-8413-0ab85b5560ba</serial>
Nov 15 22:30:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:30:57 user nova-compute[75409]: </disk>
Nov 15 22:30:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:30:57 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config.
Nov 15 22:30:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 22:30:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:30:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:30:57 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:30:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:30:57 user nova-compute[75409]:   <serial>9833e68b-e80b-4a04-8413-0ab85b5560ba</serial>
Nov 15 22:30:57 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:30:57 user nova-compute[75409]: </disk>
Nov 15 22:30:57 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:30:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 22:30:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:18 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 is timed out.
Nov 15 22:31:18 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config.
Nov 15 22:31:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EagrOcev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:31:18 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[031811a7-f282-49f4-8274-1c3fc48d258f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:31:18 user nova-compute[75409]: No targets found.
Nov 15 22:31:18 user nova-compute[75409]: iSNS:
Nov 15 22:31:18 user nova-compute[75409]: No targets found.
Nov 15 22:31:18 user nova-compute[75409]: STATIC:
Nov 15 22:31:18 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba
Nov 15 22:31:18 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:31:18 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:31:18 user nova-compute[75409]: FIRMWARE:
Nov 15 22:31:18 user nova-compute[75409]: No targets found.
Nov 15 22:31:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:31:18 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:31:18 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85d1f9-dfc2-44ec-8127-e36d8ecfcf22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f8342-c389-4e30-b478-452ee0843dbf]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)
Nov 15 22:31:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba (non-flash)
Nov 15 22:31:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf48101e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69fac85-f2e7-4f45-9a45-5f57a29d8528]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a324673-1f76-48eb-928b-c8daeb7a86d9]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df105822-aa8d-4421-a7d7-0e51d1e983d3]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee255ce-cc11-4264-b265-8164553001a3]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d062b3-f8f9-44e4-84e5-8134726b8820]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee55fe-8bfa-4750-ae68-011bffc8077c]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260]
Nov 15 22:31:18 user nova-compute[75409]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba, portal: 172.16.0.220,3260] successful.
Nov 15 22:31:18 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9833e68b-e80b-4a04-8413-0ab85b5560ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b3c77-d6a4-4db7-a514-15e612f92d47]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== disconnect_volume: return (300ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:31:18 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:31:19 user nova-compute[75409]: DEBUG nova.objects.instance [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:31:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-b4026c22-9d8f-4e34-bada-14ee78209865 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:31:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:40 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:31:42 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=24.932029724121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing inventories for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating ProviderTree inventory for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Updating inventory in ProviderTree for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 22:31:42 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing aggregate associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, aggregates: None {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 22:31:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Refreshing trait associations for resource provider 6d992785-dcac-407e-b10c-2f8c1f949a7e, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3 {{(pid=75409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 22:31:43 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:31:43 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:31:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:31:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:31:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 22:31:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG nova.objects.instance [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:31:49 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:31:49 user nova-compute[75409]: INFO nova.compute.manager [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attaching volume 3bb3ab93-b353-465d-ab82-6a2f04d6eaee to /dev/vdb
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e8cd6e-a7b2-47d3-9e4e-a0f30c42ef6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d24708-635e-464d-8e03-9a2a2bbd865f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab8cfe-ddb1-4c34-98c2-421eecaf4c20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[25801f42-fa28-4de4-8c85-61332f4603ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:31:50 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 22:31:50 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1951c2-271c-4b6c-a415-673987e82bc6]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG os_brick.utils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating existing volume attachment record: 8e0d7c92-6c75-470c-bbf3-e3dfc02556ef {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 22:31:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXDWcvjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:31:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:31:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:31:54 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[845be689-7f8d-473b-ad75-548d3d7874cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 22:31:54 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aea380-f1de-4181-8bb6-44a5234414bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee] added
Nov 15 22:31:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e902e-c63d-46ad-8655-36dce8b14c25]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3c289-c2d5-4392-92e9-46726d03fcbc]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXDWcvjl {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXDWcvjl" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b3407-54e9-430e-a6fc-f0583057e78d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXDWcvjl'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0671d2c-c47f-4a65-ba5b-0a39148fa8b0]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f1613c-679c-4cc2-813e-7b84a536d831]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:31:54 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:31:54 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:31:54 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 22:31:54 user nova-compute[75409]: 
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f47e6c-fa7a-4ac6-9cab-8ea369c8049d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260]
Nov 15 22:31:54 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260] successful.
Nov 15 22:31:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2423f8f5-7802-4317-9116-cb57402571c6]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8863ad0-3617-490e-af2b-423be6055c02]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)
Nov 15 22:31:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)
Nov 15 22:31:54 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64f5ac-697c-4464-b036-594cd96f67cc]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:31:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXDWcvjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Cleaning up deleted instances {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] There are 0 instances to clean {{(pid=75409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23662353738323031', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353738323031', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG nova.objects.instance [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:31:55 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 22:31:55 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:31:55 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:31:55 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:31:55 user nova-compute[75409]:   <serial>3bb3ab93-b353-465d-ab82-6a2f04d6eaee</serial>
Nov 15 22:31:55 user nova-compute[75409]: </disk>
Nov 15 22:31:55 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 22:31:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:31:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:31:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No VIF found with MAC fa:16:3e:73:88:16, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:31:56 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-6378a8fc-c046-4798-8bdb-76cfa6ced0b8 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.523s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:31:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:31:59 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:31:59 user nova-compute[75409]: INFO nova.compute.manager [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Detaching volume 3bb3ab93-b353-465d-ab82-6a2f04d6eaee
Nov 15 22:31:59 user nova-compute[75409]: INFO nova.virt.block_device [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attempting to driver detach volume 3bb3ab93-b353-465d-ab82-6a2f04d6eaee from mountpoint /dev/vdb
Nov 15 22:31:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Attempting to detach device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 22:31:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:31:59 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:31:59 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:31:59 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:31:59 user nova-compute[75409]:   <serial>3bb3ab93-b353-465d-ab82-6a2f04d6eaee</serial>
Nov 15 22:31:59 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:31:59 user nova-compute[75409]: </disk>
Nov 15 22:31:59 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:31:59 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config.
Nov 15 22:31:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 22:31:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:31:59 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:31:59 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:31:59 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:31:59 user nova-compute[75409]:   <serial>3bb3ab93-b353-465d-ab82-6a2f04d6eaee</serial>
Nov 15 22:31:59 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:31:59 user nova-compute[75409]: </disk>
Nov 15 22:31:59 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:31:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 22:32:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Triggering sync for uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:32:19 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 is timed out.
Nov 15 22:32:19 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config.
Nov 15 22:32:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXDWcvjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:32:19 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953e5af-57af-4e85-824d-1e288ca74a52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:32:19 user nova-compute[75409]: No targets found.
Nov 15 22:32:19 user nova-compute[75409]: iSNS:
Nov 15 22:32:19 user nova-compute[75409]: No targets found.
Nov 15 22:32:19 user nova-compute[75409]: STATIC:
Nov 15 22:32:19 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee
Nov 15 22:32:19 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:32:19 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:32:19 user nova-compute[75409]: FIRMWARE:
Nov 15 22:32:19 user nova-compute[75409]: No targets found.
Nov 15 22:32:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:32:19 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:32:19 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea08279-0f3f-467f-8623-f13252823e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8759b5-e827-4288-a99d-411541f08c44]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)
Nov 15 22:32:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee (non-flash)
Nov 15 22:32:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf0879a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f4363-d8cb-435b-8bb4-bc1e57714365]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1855c4-72c8-4c8c-b936-75b739eaecdc]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a464f027-51e7-4bc7-9151-bdbaed77ac93]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5cd3f3-84d0-465c-97e4-27de2ace05d0]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b220229-68f4-405e-80d0-18b5231c086b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc28d9-aacb-4e6f-933c-bff08a3ed2f8]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260]
Nov 15 22:32:19 user nova-compute[75409]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee, portal: 172.16.0.220,3260] successful.
Nov 15 22:32:19 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bb3ab93-b353-465d-ab82-6a2f04d6eaee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da560e-cc16-4297-b3c9-398d84a886ab]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== disconnect_volume: return (311ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:32:19 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG nova.objects.instance [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-fdba1d09-d45b-4218-b67e-133fda6d4c11 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.633s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.488s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:32:20 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:32:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:32:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:32:37 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:32:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:32:43 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=24.93099594116211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:32:43 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:32:44 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:32:44 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:32:44 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:32:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:32:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:32:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:32:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG nova.objects.instance [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:32:51 user nova-compute[75409]: INFO nova.compute.manager [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attaching volume 170ca587-c8d7-4fbd-bd67-95a6d442e702 to /dev/vdb
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.utils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[814bf6b7-d8e9-4ce6-b32e-3d65359c52b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55372ea0-bb93-4532-b8b4-c0414ad5df2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd5c92-51b1-419b-9f64-bbb377e71471]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d409a4-0a3f-4942-8208-18064e57a147]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:32:51 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 22:32:51 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29c4de-f132-425d-8bdc-74d7ebcfd9b1]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG os_brick.utils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:32:51 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating existing volume attachment record: 35d3e274-5835-4b32-9f56-5c7ec1ee5417 {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 22:32:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpojqIZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:32:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:32:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:32:56 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a27f74-f922-4488-8e2e-0be0cb3d8f16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 22:32:56 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ee2ae-8718-4f36-af47-8a75a0bdc96f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702] added
Nov 15 22:32:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b65e3f-6178-43eb-905a-9c0ef3d9a16d]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[714422b8-ffa3-44b7-bb8c-a9885cbb6fad]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpojqIZQ {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpojqIZQ" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[141a109a-e372-4d54-b6a1-3f0c62fd073a]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpojqIZQ'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[175f4e3b-884d-4ac7-8a8d-a1770549538f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e98b1c-9266-4212-a6df-09e3e2f3b01d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:32:56 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:32:56 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:32:56 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 22:32:56 user nova-compute[75409]: 
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc5046e-b048-4c82-9121-6f4f57c55288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260]
Nov 15 22:32:56 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260] successful.
Nov 15 22:32:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f889e-d498-4bae-beaf-bc9e959bf9ea]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e53ec-30cd-44c9-a922-dffb9a2d69ee]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)
Nov 15 22:32:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)
Nov 15 22:32:56 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[425922c5-3d90-4b48-97bd-386dda51e190]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:32:56 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpojqIZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26133653833643436', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133653833643436', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.objects.instance [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 22:32:57 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:32:57 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:32:57 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:32:57 user nova-compute[75409]:   <serial>170ca587-c8d7-4fbd-bd67-95a6d442e702</serial>
Nov 15 22:32:57 user nova-compute[75409]: </disk>
Nov 15 22:32:57 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No VIF found with MAC fa:16:3e:73:88:16, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:32:57 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-37ed7b80-bc29-4525-80b5-bb521a44cba3 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.521s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:33:00 user nova-compute[75409]: INFO nova.compute.manager [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Detaching volume 170ca587-c8d7-4fbd-bd67-95a6d442e702
Nov 15 22:33:00 user nova-compute[75409]: INFO nova.virt.block_device [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attempting to driver detach volume 170ca587-c8d7-4fbd-bd67-95a6d442e702 from mountpoint /dev/vdb
Nov 15 22:33:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Attempting to detach device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:33:00 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:33:00 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:33:00 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:33:00 user nova-compute[75409]:   <serial>170ca587-c8d7-4fbd-bd67-95a6d442e702</serial>
Nov 15 22:33:00 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:33:00 user nova-compute[75409]: </disk>
Nov 15 22:33:00 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:33:00 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config.
Nov 15 22:33:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:33:00 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:33:00 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:33:00 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:33:00 user nova-compute[75409]:   <serial>170ca587-c8d7-4fbd-bd67-95a6d442e702</serial>
Nov 15 22:33:00 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:33:00 user nova-compute[75409]: </disk>
Nov 15 22:33:00 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:33:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:01 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 22:33:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:21 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 is timed out.
Nov 15 22:33:21 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config.
Nov 15 22:33:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpojqIZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:33:21 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e169da-1dfa-451f-97db-46e769d63a27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:33:21 user nova-compute[75409]: No targets found.
Nov 15 22:33:21 user nova-compute[75409]: iSNS:
Nov 15 22:33:21 user nova-compute[75409]: No targets found.
Nov 15 22:33:21 user nova-compute[75409]: STATIC:
Nov 15 22:33:21 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702
Nov 15 22:33:21 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:33:21 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:33:21 user nova-compute[75409]: FIRMWARE:
Nov 15 22:33:21 user nova-compute[75409]: No targets found.
Nov 15 22:33:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:33:21 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:33:21 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc7e54-4b7a-4341-b119-d5c0970883fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae4dd5-ff72-411f-894d-54f84f0a98c4]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)
Nov 15 22:33:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 (non-flash)
Nov 15 22:33:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf281ce560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2db8e3-7ece-441b-86bf-21839b7501f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82387488-d268-4d42-b3e6-1ad33888dc70]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8879bc-3908-4ab2-8c66-db797ed12f09]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51735dc-c8c4-48f6-8a43-e32377f967cd]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a529c62f-ed73-4f6b-80e2-6f08c4052b71]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e3c18-29da-416d-8cea-7f32680a0bb6]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260]
Nov 15 22:33:21 user nova-compute[75409]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702, portal: 172.16.0.220,3260] successful.
Nov 15 22:33:21 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170ca587-c8d7-4fbd-bd67-95a6d442e702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[772189ea-1ce5-4879-999a-0466a07faf22]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== disconnect_volume: return (292ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:33:21 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:33:22 user nova-compute[75409]: DEBUG nova.objects.instance [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:33:22 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-00c2f3c9-ee1d-47d1-9369-fcd5771a0eb7 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:33:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:36 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:36 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:33:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:41 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:42 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:33:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:33:45 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.93001937866211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:33:45 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:33:46 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:33:46 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:33:46 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:33:46 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:33:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:49 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:33:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:33:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:33:52 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:33:52 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:33:53 user nova-compute[75409]: INFO nova.compute.manager [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attaching volume 35fd00c1-c63d-4c45-85fa-2b63ac6064ba to /dev/vdb
Nov 15 22:33:53 user nova-compute[75409]: DEBUG os_brick.utils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:33:53 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b3019-a152-4391-9902-3c61c2a0d4f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:879723ad761\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239ba5b-bdef-4891-abea-ad841d79823c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[568f95fe-2dfd-41b4-b211-f743658f040a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3fc731-7d40-4e7f-b307-bada5eaab841]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Running cmd (subprocess): nvme version {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] nvme not present on system {{(pid=75409) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 22:33:54 user nova-compute[75409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 22:33:54 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb6953e-d66b-4d7b-936c-dc496d9cd116]: (4, '') {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75409) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.lightos [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] LIGHTOS: no hostnqn found. {{(pid=75409) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG os_brick.utils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:879723ad761', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:33:54 user nova-compute[75409]: DEBUG nova.virt.block_device [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating existing volume attachment record: 5c0f6126-1eca-4b67-9cea-b2a2b845d9ff {{(pid=75409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 22:33:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:33:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Calling os-brick to attach iSCSI Volume {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfIhNpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:33:58 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:33:58 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:33:58 user nova-compute[75409]: INFO os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80c0cf-61ad-47d5-8853-9737fc49e11e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 22:33:58 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6ead1-f4ee-4929-a3c9-3964ed835ee9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba] added\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba] added
Nov 15 22:33:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[06506f2f-bdf5-49e4-b9e9-663d32f81c58]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64edac8-97e2-4e3a-bf2d-85f72fa228b7]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsfIhNpq {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsfIhNpq" returned: 0 in 0.020s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e27eec-7c47-4f4c-932a-bcdae32cb23b]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OsfIhNpq'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b13c6c8-860b-4660-b68a-06257bbb5b2f]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b069cc4-6122-439c-b95f-92ba53001069]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:33:58 user nova-compute[75409]:  {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 22:33:58 user nova-compute[75409]:  {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:33:58 user nova-compute[75409]: WARNING os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 22:33:58 user nova-compute[75409]: 
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --login {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a874198-c159-464e-a627-584c10312980]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260]
Nov 15 22:33:58 user nova-compute[75409]: Login to [iface: default, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260] successful.
Nov 15 22:33:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641ac31-911a-426a-a4cc-f7a8e756b597]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977bb79-2a37-4c9c-a952-407c2ebe8eab]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)
Nov 15 22:33:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)
Nov 15 22:33:58 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to 172.16.0.220:3260 {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75409) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75409) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713a614-9f39-423c-98a9-068a60256922]: (4, ('- - 0', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:33:58 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75409) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfIhNpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75409) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23634303739313733', 'path': '/dev/sdb'} {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634303739313733', 'path': '/dev/sdb'} {{(pid=75409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 22:33:59 user nova-compute[75409]: DEBUG nova.objects.instance [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 22:34:00 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:34:00 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:34:00 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:34:00 user nova-compute[75409]:   <serial>35fd00c1-c63d-4c45-85fa-2b63ac6064ba</serial>
Nov 15 22:34:00 user nova-compute[75409]: </disk>
Nov 15 22:34:00 user nova-compute[75409]:  {{(pid=75409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] No VIF found with MAC fa:16:3e:73:88:16, not building metadata {{(pid=75409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 22:34:00 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-7b477658-1cb4-4fc5-84f5-eb2cbbd7b35e tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.675s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:34:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:34:02 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:34:03 user nova-compute[75409]: INFO nova.compute.manager [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Detaching volume 35fd00c1-c63d-4c45-85fa-2b63ac6064ba
Nov 15 22:34:03 user nova-compute[75409]: INFO nova.virt.block_device [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Attempting to driver detach volume 35fd00c1-c63d-4c45-85fa-2b63ac6064ba from mountpoint /dev/vdb
Nov 15 22:34:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Attempting to detach device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config. {{(pid=75409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 22:34:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:34:03 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:34:03 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:34:03 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:34:03 user nova-compute[75409]:   <serial>35fd00c1-c63d-4c45-85fa-2b63ac6064ba</serial>
Nov 15 22:34:03 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:34:03 user nova-compute[75409]: </disk>
Nov 15 22:34:03 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:34:03 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the persistent domain config.
Nov 15 22:34:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config. {{(pid=75409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 22:34:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.guest [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 22:34:03 user nova-compute[75409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 22:34:03 user nova-compute[75409]:   <source dev="/dev/sdb"/>
Nov 15 22:34:03 user nova-compute[75409]:   <target dev="vdb" bus="virtio"/>
Nov 15 22:34:03 user nova-compute[75409]:   <serial>35fd00c1-c63d-4c45-85fa-2b63ac6064ba</serial>
Nov 15 22:34:03 user nova-compute[75409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 22:34:03 user nova-compute[75409]: </disk>
Nov 15 22:34:03 user nova-compute[75409]:  {{(pid=75409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 22:34:03 user nova-compute[75409]: DEBUG nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:10 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:15 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:20 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:23 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40765211-0858-4249-8dfe-fafe530ae799 is timed out.
Nov 15 22:34:23 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully detached device vdb from instance 40765211-0858-4249-8dfe-fafe530ae799 from the live domain config.
Nov 15 22:34:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] calling os-brick to detach iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf28664160>, {'target_iqn': 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfIhNpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 22:34:23 user nova-compute[75409]: WARNING os_brick.initiator.connectors.base [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b780c85-6921-4a5a-9595-4a74e6907170]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 22:34:23 user nova-compute[75409]: No targets found.
Nov 15 22:34:23 user nova-compute[75409]: iSNS:
Nov 15 22:34:23 user nova-compute[75409]: No targets found.
Nov 15 22:34:23 user nova-compute[75409]: STATIC:
Nov 15 22:34:23 user nova-compute[75409]: Target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba
Nov 15 22:34:23 user nova-compute[75409]:         Portal: 172.16.0.220:3260,-1
Nov 15 22:34:23 user nova-compute[75409]:                 Iface Name: default
Nov 15 22:34:23 user nova-compute[75409]: FIRMWARE:
Nov 15 22:34:23 user nova-compute[75409]: No targets found.
Nov 15 22:34:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 22:34:23 user nova-compute[75409]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 22:34:23 user nova-compute[75409]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75409) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba', 0)] {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814cac6-3a4c-4f01-acdc-c900d78a50b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03173125-b28b-47f6-911d-595afa94f36f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)
Nov 15 22:34:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba (non-flash)
Nov 15 22:34:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf2877d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba'): ({'sdb'}, set())}) {{(pid=75409) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Removing single pathed devices sdb {{(pid=75409) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e6246b-908a-44a2-b1dc-a79b1eeaf34b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b654f80e-90c7-4ddd-9ded-8e1900c1dfa2]: (4, ('ok\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Flushing IO for device /dev/sdb {{(pid=75409) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3eeddf-eb5d-46a1-884c-95970b020937]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75409) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ba779-2dd7-4274-b132-7dfe50a9132f]: (4, ('1', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.linuxscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] SCSI volumes sdb have been removed. {{(pid=75409) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba')] {{(pid=75409) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9ad9e-1a3c-4ea3-a1c5-3ed393a46657]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --logout {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607f345-cff6-4d4c-9bdb-373f914d6f81]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260]
Nov 15 22:34:23 user nova-compute[75409]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba, portal: 172.16.0.220,3260] successful.
Nov 15 22:34:23 user nova-compute[75409]:  stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op delete {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35fd00c1-c63d-4c45-85fa-2b63ac6064ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c28ebf6-4a22-4bab-bf7d-cce3d6be7849]: (4, ('', '')) {{(pid=86679) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75409) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.base [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] <== disconnect_volume: return (306ms) None {{(pid=75409) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 22:34:23 user nova-compute[75409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Disconnected iSCSI Volume {{(pid=75409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 22:34:24 user nova-compute[75409]: DEBUG nova.objects.instance [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'flavor' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:34:24 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-d1c62556-7c76-47f0-b69e-b197ab679aa0 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:34:25 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:30 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:35 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:38 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:34:40 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquired lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Forcefully refreshing network info cache for instance {{(pid=75409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.objects.instance [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lazy-loading 'info_cache' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.network.neutron [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [{"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Releasing lock "refresh_cache-40765211-0858-4249-8dfe-fafe530ae799" {{(pid=75409) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updated the network info_cache for instance {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 22:34:44 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:45 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:45 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.processutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75409) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 22:34:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:34:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:34:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=24.929035186767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:34:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Instance 40765211-0858-4249-8dfe-fafe530ae799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:34:48 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:50 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:34:55 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:00 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:05 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:09 user nova-compute[75409]: INFO nova.compute.manager [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Terminating instance
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Start destroying the instance on the hypervisor. {{(pid=75409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-unplugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] No waiting events found dispatching network-vif-unplugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [req-8badee51-e514-4000-b1e8-0223a626fcd1 req-62976889-9da9-4bdb-876c-75e5f01eb34a service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-unplugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 for instance with task_state deleting. {{(pid=75409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Instance destroyed successfully.
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.objects.instance [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lazy-loading 'resources' on Instance uuid 40765211-0858-4249-8dfe-fafe530ae799 {{(pid=75409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.virt.libvirt.vif [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T22:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2054424469',display_name='tempest-SnapshotDataIntegrityTests-server-2054424469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2054424469',id=53,image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFtPMM41TKX+t7je0A3SieGK2CiogNXtZnkzG+aSMVTExdXcpSi3022Uvng8S3T/5kWKVD1SW+UXyjV8PnCboN3VlN402jPPyy9djktATZ36PDm/zHFGgRMEq1ioNud6w==',key_name='tempest-keypair-1467300331',keypairs=<?>,launch_index=0,launched_at=2023-11-15T22:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4f7e634d204b1cb8ee7c5db8dd094e',ramdisk_id='',reservation_id='r-8r306at8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2224a-f851-4f51-8b88-3264d76e2cea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-732686207',owner_user_name='tempest-SnapshotDataIntegrityTests-732686207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T22:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaca9dab6c4241f1b1a564e2d265ae26',uuid=40765211-0858-4249-8dfe-fafe530ae799,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converting VIF {"id": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "address": "fa:16:3e:73:88:16", "network": {"id": "3a65677b-9729-4e2b-95a3-e8a15ce7717d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1758862331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4f7e634d204b1cb8ee7c5db8dd094e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb86c127f-b2", "ovs_interfaceid": "b86c127f-b2bc-49ec-bd2f-19219c9bac44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.network.os_vif_util [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2') {{(pid=75409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG os_vif [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2') {{(pid=75409) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb86c127f-b2, bridge=br-int, if_exists=True) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdd6d960-9145-460d-b852-3b774d9d7835) {{(pid=75409) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:09 user nova-compute[75409]: INFO os_vif [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:88:16,bridge_name='br-int',has_traffic_filtering=True,id=b86c127f-b2bc-49ec-bd2f-19219c9bac44,network=Network(3a65677b-9729-4e2b-95a3-e8a15ce7717d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb86c127f-b2')
Nov 15 22:35:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Deleting instance files /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799_del
Nov 15 22:35:09 user nova-compute[75409]: INFO nova.virt.libvirt.driver [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Deletion of /opt/stack/data/nova/instances/40765211-0858-4249-8dfe-fafe530ae799_del complete
Nov 15 22:35:09 user nova-compute[75409]: INFO nova.compute.manager [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 22:35:09 user nova-compute[75409]: DEBUG oslo.service.loopingcall [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75409) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.compute.manager [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Deallocating network for instance {{(pid=75409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 22:35:09 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] deallocate_for_instance() {{(pid=75409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 22:35:10 user nova-compute[75409]: DEBUG nova.network.neutron [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Updating instance_info_cache with network_info: [] {{(pid=75409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 22:35:10 user nova-compute[75409]: INFO nova.compute.manager [-] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Took 0.75 seconds to deallocate network for instance.
Nov 15 22:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:10 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:35:10 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:35:10 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:10 user nova-compute[75409]: INFO nova.scheduler.client.report [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Deleted allocations for instance 40765211-0858-4249-8dfe-fafe530ae799
Nov 15 22:35:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-5f343719-cea6-4ba8-afce-430b2fda4f78 tempest-SnapshotDataIntegrityTests-732686207 tempest-SnapshotDataIntegrityTests-732686207-project-member] Lock "40765211-0858-4249-8dfe-fafe530ae799" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:35:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] Acquiring lock "40765211-0858-4249-8dfe-fafe530ae799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:11 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] Lock "40765211-0858-4249-8dfe-fafe530ae799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] No waiting events found dispatching network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 22:35:11 user nova-compute[75409]: WARNING nova.compute.manager [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received unexpected event network-vif-plugged-b86c127f-b2bc-49ec-bd2f-19219c9bac44 for instance with vm_state deleted and task_state None.
Nov 15 22:35:11 user nova-compute[75409]: DEBUG nova.compute.manager [req-ce36bd6c-1edd-4b65-8bac-c21f6b3f3fd2 req-43921622-2f72-4fd7-bc7e-33022afd4299 service nova] [instance: 40765211-0858-4249-8dfe-fafe530ae799] Received event network-vif-deleted-b86c127f-b2bc-49ec-bd2f-19219c9bac44 {{(pid=75409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 22:35:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:29 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:34 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:38 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:39 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:39 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 22:35:39 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:43 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:44 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Starting heal instance info cache {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Rebuilding the list of instances to heal {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG nova.compute.manager [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Didn't find any instances for network info cache update. {{(pid=75409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:46 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Auditing locally available compute resources for user (node: user) {{(pid=75409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 22:35:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:35:47 user nova-compute[75409]: WARNING nova.virt.libvirt.driver [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Hypervisor/Node resource view: name=user free_ram=9172MB free_disk=24.956195831298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.provider_tree [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed in ProviderTree for provider: 6d992785-dcac-407e-b10c-2f8c1f949a7e {{(pid=75409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.scheduler.client.report [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Inventory has not changed for provider 6d992785-dcac-407e-b10c-2f8c1f949a7e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG nova.compute.resource_tracker [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Compute_service record updated for user:user {{(pid=75409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 22:35:47 user nova-compute[75409]: DEBUG oslo_concurrency.lockutils [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75409) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 22:35:48 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:35:49 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:51 user nova-compute[75409]: DEBUG oslo_service.periodic_task [None req-261cb742-953f-4a87-9b01-8c0fe0d9c699 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75409) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 22:35:54 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:35:59 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:03 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:04 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:06 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:09 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75409) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75409) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 22:36:14 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:19 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 22:36:24 user nova-compute[75409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75409) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}